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TO 

MICHAEL 



PREFACE 


The present volume is the second in the author’s series of 
three dealing with abstract algebra. For an understanding of 
this volume a certain familiarity with the basic concepts treated 
in Volume I: groups ， rings, fields ， homomorphisms, is presup¬ 
posed. However, we have tried to make this account of linear 
algebra independent of a detailed knowledge of our first volume. 
References to specific results are given occasionally but some of 
the fundamental concepts needed have been treated again. In 
short, it is hoped that this volume can be read with complete 
understanding by any student who is mathematically sufficiently 
mature and who has a familiarity with the standard notions of 
modern algebra. 

Our point of view in the present volume is basically the abstract 
conceptual one. However，from time to time we have deviated 
somewhat from this. Occasionally formal calculational methods 
yield sharper results. Moreover, the results of linear algebra are 
not an end in themselves but are essential tools for use in other 
branches of mathematics and its applications. It is therefore 
useful to have at hand methods which are constructive and which 
can be applied in numerical problems. These methods sometimes 
necessitate a somewhat lengthier discussion but we have felt that 
their presentation is justified on the grounds indicated. A stu¬ 
dent well versed in abstract algebra will undoubtedly observe 
short cuts. Some of these have been indicated in footnotes. 

We have included a large number of exercises in the text. 
Many of these are simple numerical illustrations of the theory. 
Others should be difficult enough to test the better students. At 
any rate a diligent study of these is essential for a thorough un¬ 
derstanding of the text. 
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FINITE DIMENSIONAL VECTOR SPACES 


In three-dimensional analytic geometry, vectors are defined geo¬ 
metrically. The definition need not be recalled here. The im¬ 
portant fact from the algebraic point of view is that a vector v 
is completely determined by its three coordinates ($ ， ry ， f) (rela¬ 
tive to a definite coordinate system). It is customary to indi¬ 
cate this by writing v = rj y f), meaning thereby that v is the 
vector whose x- y y- y and 2 — coordinates are ， respectively, ^ 77 , and 
Conversely, any ordered triple of real numbers ( 芒， 77 ， f) de¬ 
termines a definite vector. Thus there is a 1-1 correspondence 
between vectors in 3-space and ordered triples of real numbers. 

There are three fundamental operations on vectors in geometry: 
addition of vectors, multiplication of vectors by scalars (numbers) 
and the scalar product of vectors. Again，we need not recall the 
geometric definitions of these compositions. It will suffice for our 
purposes to describe the algebraic processes on the triples that 
correspond to these geometric operations. If v = rj y f) and 
v f = rj\ ^) y then the sum 

v + v f = ($ + 芒 ’， n + ”’， f + f’)- 
The product pv of the vector v by the real number p is the vector 

pv = (pf, PV> pD 

and the scalar product (v y v f ) of v and 〆 is the real number 

(v y v r ) = ^ + vv + rr 7 - 

A substantial part of analytic geometry — the theory of linear 
dependence and of linear transformations — depends only on the 
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first two of these concepts. It is this part (in a generalized form) 
which constitutes the main topic of discussion in these Lectures. 
The concept of scalar product is a metric one，and this will be 
relegated to a relatively minor role in our discussion. 

The study of vectors relative to addition and multiplication 
by numbers can be generalized in two directions. First, it is not 
necessary to restrict oneself to the consideration of triples; in¬ 
stead, one may consider 衫 -tuples for any positive integer n. 
Second，it is not necessary to assume that the coordinates ^ rj y 
… are real numbers. To insure the validity of the theory of 
linear dependence we need suppose only that it is possible to 
perform rational operations. Thus any field can be used in place 
of the field of real numbers. It is fairly easy to go one step fur¬ 
ther, namely, to drop the assumption of commutativity of the 
basic number system. 

We therefore begin our discussion with a given division ring A. 
For example，△ may be taken to be any one of the following sys¬ 
tems: 1) the field of real numbers, 2) the field of complex num¬ 
bers, 3) the field of rational numbers ， 4) the field of residues 
modulo p y or 5) the division ring of real quaternions. 

Let ^ be a fixed positive integer and let A (n) denote the to¬ 
tality of "-tuples (?i ， $ 2 ， •••，&) with the ^ in A. We call these 
"-tuples vectors 、 and we call A (n) the vector space of n-tuples over 
Ify = (rj ly rj 2y • . .， ” n )， we regard x = y and only if ^ = rji 
for / = 1 ，2 ， •••，"• Following the pattern of the three-dimen¬ 
sional real case，we introduce two compositions in A ⑻： addition 
of vectors and multiplication of vectors by elements of A. First ， 
if at and y are arbitrary vectors, we define their sum % + jy to be 
the vector 

X + y = (Jl + ”1， + ”2 ，…，会 n + Vn)- 

As regards to multiplication by elements of A there are two possi¬ 
bilities: left multiplication defined by 

= Of 1 ， P?2, … ， P?n) 
and right multiplication defined by 

= (f lP ，？ 2P，. • • ， fnP). 
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Either of these can be used. Parallel theories will result from the 
two choices. In the sequel we give preference to left multiplica¬ 
tion. It goes without saying that all of our results may be trans¬ 
ferred to results on right multiplication. 

The first eight chapters of this volume will be devoted to the 
study of the systems △⑻ relative to the compositions we have 
just defined. The treatment which we shall give will be an axio¬ 
matic one in the sense that our results will all be derived from a 
list of simple properties of the systems △⑻ that will serve as 
axioms. These axioms define the concept of a finite dimensional 
{abstract) vector space and the systems A (n) are instances of such 
spaces. Moreover, as we shall see，any other instance of a finite 
dimensional vector space is essentially equivalent to one of the 
systems A (n) . 

Thus the shift to the axiomatic point of view is not motivated 
by the desire to gain generality. Its purposes are rather to clar¬ 
ify the discussion by focusing attention on the essential proper¬ 
ties of our systems, and to make it easier to apply the results to 
other concrete instances. Finally, the broadening of the point 
of view leads naturally to the consideration of other, more gen¬ 
eral, concepts which will be useful in studying vector spaces. 
The most important of these is the concept of a module which 
will be our main tool in the theory of a single linear transforma¬ 
tion (Chapter III). In order to prepare the ground for this ap¬ 
plication we shall consider this concept from the beginning of our 
discussion. 

The present chapter will be devoted to laying the foundations 
of the theory of vector spaces. The principal concepts that we 
shall consider are those of basis，linear dependence, subspace, 
factor space and the lattice of subspaces. 

1. Abstract vector spaces. We now list the properties of the 
compositions in △⑻ from which the whole theory of these sys¬ 
tems will be derived. These are as follows : 

A1 0 + j) + 2 = x + (y + z). 

A2 x + y = y + x. 

A3 There exists an element 0 such that ^ + 0 = ^ for all x. 


FINITE DIMENSIONAL VECTOR SPACES 


A4 For any vector ^ there exists a vector 一 x such that % + 
( — x) = 0. 


SI 

ol{x + jy)= 

ax + ay. 

S2 

(a + I3)x = 

ax + 

S3 

(a/3)x = 

a(/3x) • 

S4 

1^ = 

X. 


F There exist a finite number of vectors ^ 2 , • • *, e n such 
that every vector can be written in one and only one way 
in the form ^ x ei + ^2 + • • • + 

The verifications of Al，A2，S1-S4 are immediate. We can 
prove A3 by observing that (0, 0, •••，（)）has the required prop¬ 
erty and A4 by noting that， if x = (^， • . then we can 

take —x= ( —Si，• • •，一Sn). To prove F we choose for 

1 

( 1 ) ei = ( 0 , 0 ， • . . ， 0 ， 1 ， 0 ， • • • ， 0 )，i = 1 ， 2 ， •••，". 

n 

Then has 匕 in its ith place，0’s elsewhere. Hence ^2 ^i e i = 

1 

(会 1 ， ？ 2 ， . • •，fn). Hence if x = (^ 1 ，• • •，D， then ^ can be 
written as the “linear combination” of the vectors Also 

our relation shows that, if then (专 i 3 ^ 2 ， • • • ， fn)= 

(” 1 ，巧 2 ， • • •， in) so that = r}i for i = 1，2， ...，"• This is what 
is meant by the uniqueness assertion in F. 

The properties A1-A4 state that A ⑻ is a commutative group 
under the composition of addition. The properties S1-S4 are 
properties of the multiplication by elements of A and relations 
between this composition and the addition composition. Prop¬ 
erty F is the fundamental finiteness condition. 

We shall now use these properties to define an abstract vector 
space. By this we mean a system consisting of 1) a commutative 
group 況 (composition written as +)，2) a division ring △，3) a 
function defined for all the pairs (p, x)^ p in A, ^ in having values 
px in such that S1-S4 hold. In analogy with the geometric 
case of ^-tuples we call the elements of 9? vectors and the elements 
of A scalars. In our discussion the emphasis will usually be placed 



FINITE DIMENSIONAL VECTOR SPACES 



on dt. For this reason we shall also refer to dt somewhat inex¬ 
actly as a “vector space over the division ring △•” (Strictly 
speaking dt is only the group part of the vector space.) If F holds 
in addition to the other assumptions, then we say that 9 ? is finite 
dimensional^ or that 況 possesses a finite basis over A. 

The system consisting of A (n) , A, and the multiplication px de¬ 
fined above is an example of a finite dimensional vector space. 
We shall describe next a situation in the theory of rings which 
gives rise to vector spaces. Let 況 be an arbitrary ring with an 
identity element 1 and suppose that dt contains a division sub¬ 
ring A that contains 1. For the product px y p in A, and a; in 9? 
we take the ring product px. Then SI-S3 are consequences of 
the distributive and associative laws of multiplication，and S4 
holds since the identity element of A is the identity of 9 ?. Hence 
the additive group the division ring A and the multiplication 
px constitute a vector space. This space may or may not be 
finite dimensional. For example, if is the field of complex 
numbers and A is the subfield of real numbers, then 9? is finite 
dimensional; for any complex number can be written in one and 

only one way as 专 + 77 V —1 in terms of the “vectors” 1 ， 1 . 
Another example of this type is 況 =A[X], the polynomial ring 
in the transcendental element (indeterminate ) 入 with coefficients 
in the division ring A. We shall see that this vector space is not 
finite dimensional (see Exercise 1, p. 13). Similarly we can re¬ 
gard the polynomial ring △[入 1 ，入 2 ， • •. ， 入 r] where the Xi are alge¬ 
braically independent (independent indeterminates) as a vector 
space over A. 

Other examples of vector spaces can be obtained as subspaces 
of the spaces defined thus far. Let 況 be any vector space over 
A and let © be a subset of that is a subgroup and that is closed 
under multiplication by elements of A. By this we mean that if 
y e (B and p is arbitrary in A then py e ©. Then it is clear that 
the trio consisting of A and the multiplication py is a vector 
space; for, since S1-S4 hold in 況 ， it is obvious that they hold 
also in the subset ©. We call this a subspace of the given vector 
space, and also we shall call © a subspace of As an example ， 
let 9? = A[X] and let © be the subset of polynomials of degree 
<n. It is immediate that © is a subspace. Moreover, it is 
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finite dimensional since any polynomial of degree <n can be ex¬ 
pressed in one and only one way as a linear combination of the 
polynomials 1， X， • • 、 X n_1 . 

EXERCISE 

1 . Show that the totality © of homogeneous quadratic polynomials 
^ aijXiXj, an in A, is a finite dimensional subspace of △[入 1’ 入 2]. 

2. Right vector spaces. As we have pointed out at the begin¬ 
ning the system △⑻ of 万 -tuples can also be studied relative to 
addition and to right multiplication by scalars. This leads us to 
define the concept of a right vector space. By this we mean a 
system consisting of a commutative group a division ring A 
and a function of pairs (p，〆)，p in 〆 in 沉’， having values x f p 
in 9? / and satisfying: 


S，1 

+ y f )<^ 二 

=x f a + y ; a. 

S，2 

x\a + /5)= 

= x f a + x f (3. 

S，3 

x\a^) = 

=(x 


S 7 4 

x ; l = 

=x r 

for all x f in 9? 


Obviously the theory based on this definition will parallel that 
of left vector spaces. It should be noted，however，that a right 
space over A cannot be regarded as a left space over A if this 
division ring is not commutative. For if we write ax f for x f a y 
then we have by S’3 

= X f (a/3) = = 队 ax’）. 

Hence S3: {^a)x f = ^{ax r ) holds only if 

[(a^) — ( 知 ) ]〆= 0 

for all x\ This together with S4 implies that a(3 = for all a y 
On the other hand, let A f be a division ring anti-isomorphic to 
△ and let a —> a : , be any anti-isomorphism of A onto Then 
if 9? / is a right vector space over A, may be considered a left 
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vector space over A’. This can be done by defining a’〆 to be 
x f a. Then 

(«’〆)〆= = (x r ^)a = (P’x’)a = a’(〆〆 )， 

so that S3 is now satisfied. The verification of the other rules is 
also immediate. 

3. o-modules. Before embarking on the systematic study of 
finite dimensional vector spaces we shall consider briefly the gen¬ 
eralization to modules which will be very useful later on. This 
generalization is obtained by replacing in our definition the divi¬ 
sion ring A by any ring o that has an identity. Thus we define a 
(left) ^-module to be a system consisting of a commutative group 
況 ， a ring o with an identity and a function of pairs (p ， x) y p in o 
and a; in 況 with values px in 9? satisfying S1-S4.* It is evident 
from our definitions that a vector space is simply a △-module 
where A is a division ring. 

Besides the special case of a vector space we note the following 
important instance of an o-module : Let 31 be any commutative 
group written additively and let o be the ring of integers. If 
x e dt and a e o y we define 

x + x + a times if a > 0 

0 if a = 0 

一 （ a; + x + ••• + a ;)， 一 a times if a < 0. 

Then S1-S4 are the well-known laws of multiples in 91. 

We note also that any ring with an identity o can be regarded 
as an o-module. As the group part 況 we take the additive group 
of o and we define ax for a in o and ^ in 9? to be the ring product. 
Properties S1-S4 are immediate consequences of the associative, 
distributive and identity laws for multiplication. 

As in the case of vector spaces a subset © of a module dt de¬ 
termines a submodule if © is a subgroup of 9? that is closed rela¬ 
tive to the multiplication by arbitrary elements of o. Now let 

* This definition is a slight departure from the usual one in wluch 0 need not have an 
identity and only S1-S3 are assumed. We make this change here since we shall be in¬ 
terested only in rings with identities in this volume. Right Q-modules are obtained in the 
obvious way by replacing S1-S4 by S'l-S’4. 
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S = (x a ) be an arbitrary subset of 9? and let [S] denote the to¬ 
tality of sums of the form 

(2) ^lX ai + f 2 ^a 2 H - 1" ^a m 

where the 匕 are arbitrary in o and the x ai are arbitrary in S. We 
assert that [S] is a submodule. Clearly [6*] is closed under addi¬ 
tion and under multiplication by elements of o. Also it is easy 
to see (Exercise 1 ， below) that Ox = 0 and ( —hold 
in any module，and these imply that [S] contains 0 and the nega¬ 
tive of any element in [S]. Hence [S] is a submodule of We 
note also that [S] contains the elements x a = lx a of S and that 
[S] is contained in every submodule of 況 that contains S. Be¬ 
cause of these properties we shall say that [S] is the submodule 
generated by the set S. 

If [S] = dt y then the set S is said to be a set of generators for 
9?. If = [eiy e 2y . • e n ] for some finite set S = (q ， e 2y • . •， e n \ 
then we say that 況 is finitely generated. If there exists a set of 
generators S such that every x can be written in one and only 
one way in the form e ai in S y then 況 is called a free module 

and the set S is called a basis. Thus condition F states that a 
finite dimensional vector space is a free △-module with a finite 
basis. 

It is easy to construct, for any a free o-module with n base 
elements. The construction is the same as that of △⑻. We let 
o (n) denote the totality of ^-tuples (^，$ 2 ， • • •，^ n ) with compo¬ 
nents in o. Addition and multiplication by elements of o are 
defined as before. If the ei are defined by (1), it can be seen as 
in the case of A (n) that these elements serve as a basis for o (n) . 

We consider now the fundamental concept of equivalence for 
o-modules. Let 9? and 沆 be two o-modules defined with respect 
to the same ring o. We shall say that 9? and 沆 are ^-isomorphic 
or simply equivalent if there is a 1-1 correspondence, x x oi 
dt onto 沉 such that 

(3) x y = x y y ax = ax. 

Thus x —> x is an isomorphism between the groups 況 and 资 

satisfying ax = ax for all a and x. Such a mapping will be called 
an ^-isomorphism or an equivalence. 
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1( x = then by (3) x = = 2a^-. Hence 

if the elements ei are generators for 9?， then the corresponding 
elements ^ are generators for 沆 . If = 2 氏 &， then = 

It follows from this that, if 9? is a free module with basis 
e“ then 尕 is free with basis These remarks illustrate the gen¬ 
eral principle that equivalent modules have the same properties ， 
and need not be distinguished in our discussion. 

Suppose now that dt and 尕 are two free o-modules and sup¬ 
pose that both of these modules have bases of n elements. Let 
the basis for 況 be e iy e 2y … ， e n and that for 尕 be e u e 2y .. e n . 
Then if x is any element of 9?, we write x = 2 匕 a 、and we asso¬ 
ciate with this element the element x = of 9?. Since the ei 
and the ^ are bases, this correspondence is 1—1 of 9? onto 淠 . 
Moreover, if jy = thenj = while x + y : = 2 (匕 + rji)ei 

and - 

x + y = 2 ( 匕 + rji)ei = 2 沾 + 2% 呙 =x +y. 

Also —— 

ax = X(a^i)ei = aS^ei = ax. 

Hence 況 , and 飛 are equivalent. This proves the following 

Theorem 1. Any two free o-modules which have bases of n ele¬ 
ments are equivalent. 

In particular we see that any finite dimensional vector space 
with a basis of n elements is equivalent to the space A (n) of n- 
tuples. This substantiates the assertion made before that the 
study of finite dimensional vector spaces is equivalent to the 
study of the concrete systems △⑷ •* 

EXERCISES 

1. Prove the following rules for any O-module: 1) o:0 = 0, 2) a{—x) = —ax, 
3) Ox == 0, 4) (—a)x = —ax. 

2. Show that any subset of an 0-module which is closed relative to addition 
and to multiplication by elements of 0 is a submodule. 

3. If 9? is a vector space, then ax = 0 only if a = 0 or ^ = 0. 

4. Linear dependence. From now on, unless otherwise stated, 
dt will be a finite dimensional vector space over A with basis ei y 

* A fuller account of the theory of modules can be found in Chapter VI of Volume I of 
these Lectures. However, the present discussion should be adequate for our purposes. 
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e 2y … ， e n . It is easy to see that this basis is not uniquely de¬ 
termined. For example，the set + e 2 , e 2y ^ is a second 

basis and, if a 〆0, the set ae iy e 2y • • •，is also a basis. A fun¬ 
damental theorem we shall prove in the next section is that the 
number of vectors in any basis is the same. Hence the number n y 
which we shall call the dimensionality of 9? over is an invariant. 
As a necessary preliminary to the proof of this theorem we in¬ 
vestigate now the fundamental concept of linear dependence of 
vectors. 

We say that a vector x is linearly dependent on a set of vectors 

m 

S if x e [S], This is equivalent to saying that x = ^2 for 

i 

suitable in A and suitable Xi in S. This proves the first of the 
following obvious properties of linear dependence: 1) If x is lin¬ 
early dependent on a set then x is linearly dependent on a 
finite subset of 彳； 2) x is linearly dependent on the set S = (x); 
3) if x is linearly dependent on S and T is a set containing S y 
then ^ is linearly dependent on T; 4) if % is linearly dependent on 
S and if every x a e S is linearly dependent on the set T y then x is 
linearly dependent on T, 

The vectors x 2 , • • • y x m are linearly dependent if there exist 
Pi not all 0 in A such that 0iXi + ^ 2^2 + • • • + = 0. Since 

= 0 if and only if either 戸 = 0 or = 0 ， a set consisting of a 
single vector x is linearly dependent if and only if ^ = 0. If 
m > 0 and the Xi are linearly dependent, then we can suppose 
that ， say, 9 ^ 0. Then 

m 一 1 

= 2( —/3 m _1 )/3y^y 

1 

so that x m is linearly dependent on (x ly x 2y ••• ， Con¬ 
versely if x m is linearly dependent on {x u x 2y • • •，then 
the vectors x ly x 2y • • • y x m are linearly dependent. Thus a set of 
more than one vector is a linearly dependent set if and only if 
one of the vectors in the set is linearly dependent on the remain¬ 
ing ones. If r < m and 巧 ，…， is a dependent set, then so is 

r m 

x ly • . • ， x m ； for if X Pi x i = then ^ = 0 if we take /3 r+1 
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If Xi, … ， x m are not linearly dependent，then these vectors 
are said to be linearly independent. The last property noted for 
dependent sets may also be stated in the following way: Any 
non-vacuous subset of a linearly independent set is a linearly in¬ 
dependent set. In particular，every vector in a linearly independ¬ 
ent set must be 〆 0. 

The following property will be used a number of times. Hence 
we state it formally as 

Lemma 1. IJ x 2y • - • y x m are linearly independent and Xi y x 2 , 
• • • ， %m+i are litiearly dependent，then x m+ i is linearly depend¬ 
ent on Xi y • • • ， x m . 

Proof. We have /?i^i + I3 2 x 2 + . • • + p m x m + p m+ 1 x m+1 = 0 
where some (3 k 9 ^ 0. If jS w+]L = 0， this implies that x iy • • •, x m 
are linearly dependent contrary to assumption. Hence /3 m+ i 9 ^ 0. 
We may therefore solve for x m+1 obtaining an expression for it 
in terms of … ， x m . 

We shall also require the following 

Lemma 2. Let x 2y • • 、 be a set of m > \ vectors and de¬ 
fine x/ = Xi for i = 1, 2 y ••• y m — l and x m r = x m + pxi ， Then 
the Xi are linearly independent if and only if the x/ are linearly in¬ 
dependent. 

Proof. Suppose that the Xi are linearly independent and let Pi 
be elements of A such that = 0. Then 

+ ^ 2^2 + • • • + + /3 m (*Vw + P^l) = 0 

so that 

(01 + + ^ 2^2 + • • • + = 0 . 

Hence Pi + ^ m p = ^2 = • . •== 0， and this implies that all 
the = 0. This proves that the x/ are linearly independent. 
Now^i = x/ for / = 1 ， 2， • • •，w — 1 and x m = x m ; — pxi\ hence 
the relation between the two sets of vectors is a symmetric one. 
We can conclude therefore that if the x/ are linearly independ¬ 
ent, then so are the 

Evidently we can generalize this lemma to prove that the two 
sets x u x 2y • • •, x m and Xi\ x 2 f y • • • ， x m ; where — Xi and x/ 
=Xj + PjXi y j = 2 ， • • •， w are either both dependent or both in- 
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dependent; for we can obtain the second set from the first by a 
sequence of replacements of the type given in Lemma 2. 

We come now to one of the fundamental results of the theory 
of vector spaces. 

Theorem 2. If 9^ has a basis of n vectors，then any w + 1 vec¬ 
tors in are linearly dependent. 

Proof. We prove the theorem by induction on n. Let e ly e 2y 
• • •，be a basis and let x ly x 2y …， ^ n +i be vectors in 9?. The 
theorem is clear for n = \\ for, in this case, Xi = aie u x 2 = a 2 e\ 
and either = 0 or ,v 2 = a 2 ai~ 1 Xi ， We assume now that the 
result has already been established for spaces that have bases of 
n — \ vectors. Suppose that the vectors x u x 2 , … ， *v n+1 are 
linearly independent and let 

*^1 = Oi\\e\ + Oi\2^2 + • • • + Oi\n^n 

… *^2 = « 21^1 + « 22^2 H - h Oi 2n e n 

⑷ 


^n+1 = ^n+1,1^1 + «n+l,2^2 + … • + «n+l,n^n 

be the expressions for the *v’s in terms of the basis. Now we may 
assume Xi ^ 0. Hence we can suppose that one of the an, say 
a ln) is ^ 0. Then the set x 2 \ • • • ， x n+1 ; where Xi = Xi and 
x/ = Xj — ajnain^Xiy j > 1, is a linearly independent set. It 
follows that the vectors x 2 \ x 3 ; y ••• ， x n+1 f are linearly independ¬ 
ent. But by (4) these x/ do not involve e ny that is ， x/ e @ = 
[e ly e 2y • • •， ^n-i]. Since the i < n — l, form a basis for ©， 
this contradicts the fact that the theorem holds for n — l, and 
the proof is complete. 

Remarks• 1) Since any non-vacuous subset of a linearly inde¬ 

pendent set of vectors is a linearly independent set, Theorem 2 
evidently implies that any r > n vectors in a space with a basis 
of n vectors are linearly dependent. 

2) Let be a set of vectors and let x u x 2y • • •, x r be linearly 
independent vectors in S. Either every set x 2 , • • • ， x ry x) y 
x in S y is linearly dependent or there exists an x r+ i e S such that 
(%i ， x 2y … ， x r+1 ) is independent. Similarly either every set 
( 欠 1 ，％ 2 ， • • • ，％ r+i ，^ in S y is dependent or there is an x r+2 in S 
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such that (^i, x 2y … ， x r+2 ) is independent. After a finite num¬ 
ber of steps we obtain (a^ ， x 2y • • • ， x m ) y in a linearly inde¬ 
pendent subset of S such that any larger subset of S is linearly 
dependent. Thus any linearly independent subset of a set of 
vectors S can be imbedded in a maximal linearly independent 
subset of S. 

3) The method of proof of Theorem 2 can be used to test a 
given finite set x 2 , • • • ， x m for linear dependence. If = 0 
the set is certainly dependent. Otherwise, we can replace this 
set by x iy x 2 \ …， xj where Xi involves, say e ny but the x/ do 
not，and such that the second set is linearly independent if and 
only if the original set is linearly independent. Now it is easy 
to see that since Xi involves e n while the x/ do not，then x iy x 2 \ 
…， xj is linearly independent if and only if x 2 \ *v 3 ’ ， … ， x m f is 
linearly independent. This reduces the problem to one of test¬ 
ing m — \ vectors in a space with a basis of w — 1 vectors. 

EXERCISES 

1. Prove that the vector space A[X] of polynomials in X is infinite dimensional. 

2. Test for linear dependence: 

(a) (2, — 5, 2, —3), (—1 ，一 3, 3, 一 1) ，（ 1 ， 1 ， 一 1 ， 0) ， (—1, 1, 0, 1) 

(b) (2, -3, 0, 4), (6, -7, -4,10), (0, -1, 2,1) 

(c) (1, 1, 1, 1), (1, 2, 3, 4), (1,4, 9, 16), (1, 8, 27, 64). 

n 

3. Show that the vectors Xi = X) t = 1, 2, •••，;》, are linearly dependent 

i = i 

if and only if the system of equations 

+ 专 2^21 + . • • + ^mOiml = 0 

( 5 ) ^1^12 + 专 2«22 + • • • + = 0 

• ♦ • • • • • 

+ ?2«2n + • • . + = 0 

has a non-trivial solution ( 匕，专 2 , •.. ， $m) = (ft, 卢 2 , … ， ftn) _ (0, 0,… ， 0). 
Use this to prove that any system (5) whose coefficients are in a division ring 
A has a non-trivial solution in A, provided the number m of unknowns exceeds 
the number n of equations. 

(A similar result can be proved for “right-handed” systems = 0 by 

using right vector spaces.) 

5. Invariance of dimensionality. A set of vectors (/) has been 
called a set of generators for dt if every x can be expressed in the 
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form 災山 for suitable fi in (/) and suitable in A. If e u 

• • •，〜is a basis，these elements are，of course ， generators. More¬ 
over, they are linearly independent; for if = 0， then 

+ ^ 2^2 + • • • + = O^i + 0e 2 + • • • + 0e n . 

Hence by the uniqueness of the representation，each = 0. 
Conversely，any finite set of generators 九 / 2 ，…，/饥 which are 
linearly independent form a basis. Thus if 2 沾 = 2” 乂 ， then 
2(^- — rji)fi = 0. Hence ^ — rji = 0 and ^ = rji for f = 1 ， 2, 

• • It follows from Theorem 2 that the number m of vec¬ 

tors in any basis 九 / 2 ，…，/饥 does not exceed n. By reversing 
the roles of the e\ and the/’s，we obtain n < m. Hence m = n. 
This proves the following fundamental 

Theorem 3. Any basis of 9? contains n vectors. 

The number n of elements in a basis is therefore uniquely de¬ 
termined. We shall call this number the dimensionality of 9? 
over A. 

We have seen that if and 尕 are equivalent free o-modules, 
then any basis • • •, e n for 況 yields a basis 孑 1 ，&， • • 、 e n 

for SR. It follows that equivalent vector spaces have the same 
dimensionality. In particular we see that the spaces A (m) and 
A (n) are not equivalent \i m n. 

We prove next the following 

Theorem 4. IJ •••，//• are linearly independent^ then we 

can supplement these vectors with n — r vectors chosen from a basis 
e iy e 2 y e n to obtain a basis. 

Proof. We consider the set (/i ， / 2 ， … ， Jr' e 2 , . • . ， e n ), and 
we choose in this set a maximum linearly independent set (/ x , 
f 2 y … ， fr. ， e h ， e i2 , • • •, e ih ) including the fi ， If we add any of the 
e 9 s to this set, we obtain a dependent set. Hence by Lemma 1 
of § 4 every ei is linearly dependent on the set (/ 1 ， … ， 人； 〜 
…， e ih ). Hence any x is dependent on this set，and the set is a 
basis. 

The number h of e\ that are added is，of course ， n — r. In 
particular we see that ， if r = n, then the fi constitute a basis. 
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Suppose next that the vectors /i, f 2y J m are generators. 
We select from this set a maximal linearly independent subset, 
and we assume that the notation has been chosen so that /i, / 2 , 
…， 人 is such a subset. Then for any (/ ly f 2y … ， f ry fi) is a 
linearly dependent set. Hence fi and consequently every x is 
linearly dependent on/i,/ 2 , … ， /r. The latter set is therefore a 
basis ， and，by Theorem 3 y r = n. Thus we see that any set of 
generators contains at least n elements and contains a subset of n 
elements that forms a basis. 


EXERCISES 

1. If/i = (1 ，一 1 ， 2, 3) and /2 = (3, 0, 4, 一 2)，find vectors fz and /a so that 

/i ， / 2 ， / 3，/4 is a basis. 

2. Find a maximum linearly independent subset in the following set of vectors: 
(2, —3,0, 4), (—1, f, 0, —2), (1, —1, 2, 1), (6, —7, 8, 8). 

3. Prove that any finitely generated △-module, △ a division ring, is a finite 
dimensional vector space. 

6. Bases and matrices. In considering finite sets of vectors, 
we shall now regard the order of these vectors as material. Thus 
we consider ordered sets. In particular we distinguish between 
the basis e\ y e 2y … y e n and the basis e iiy e hy • • •, e in where the i’s 
form a permutation of* 1 ， 2 ， •.•，”• Let {e^ e 2y • . e n ) be a par¬ 
ticular ordered set which forms a basis and let (x u x 2y … ， x r ) 

n 

be an ordered set of arbitrary vectors. We write Xi = ^ a ： 的， 

l 

i = 1, 2 y •••，，• The elements are uniquely determined. 
Hence the matrix 





«12 

… <x ln 

⑹ 

(a)= 

«21 

• 

«22 

• 

… Oi 2n 

參 • • • 




«r2 

* 仪 rn 


is uniquely determined by the ordered set (^i, x 2y … ， x r ) and 
the ordered basis (ei y e 2y ••• ， e n ). We call this matrix the matrix 
of (^i, x 2y • • . ， x r ) relative to (e ly e 2y ••• ， e n ). 

It will be well to recall at this point the basic facts concerning 
matrix multiplication.* Let (a) be an r X ^ matrix (r rows, n 

* Cf. § 4, Chapter II of Volume I of these Lectures. 
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columns) with elements in A. As above we denote the element in 
the (^i)-position, that is, in the intersection of the ith row and 
jth column by qj^*. Similarly let ( 々 )be an n X m matrix with 
elements /5 介 in We define the product to be the r X m 

matrix whose element in the (i y k) position is 

(7) dih = CXii^ik + ai 2 ^2k + • • • + O^in^nk- 

If ( 7 ) is an 衍 X g matrix with elements in △，then the products 
[(«) ⑹ ] ( 7 ) and (a)[Q3)(y)] are defined as r X q matrices. The 
(/, /) elements of these products are respectively 

S ( a ijPjk)7kh 1 OLij{^j k y k i). 

Jfk j，k 

Thus we have the associative law: [(a) = w [⑻ w]. 

If we stick to square matrices of a definite size，say n X n y 
then the product is again a matrix of the same type. Since the 
associative law holds，we can say that the totality A n of these 
matrices is a semi-group. Also it is immediate that the matrix 



is the identity in A n in the sense that (a)l = (a) = 1(a) for all 
(a) e A n . As usual for semi-groups we call a matrix (a) a unit 
if there exists a (0) such that (a) (/3) = 1 = (/3) (a) . These ma¬ 
trices are also called non-singular or regular matrices in A n . It 
is easy to verify that the totality of units of any semi-group with 
an identity constitutes a group.* In particular the totality 
L(A, n) of non-singular matrices is a group relative to multipli¬ 
cation. As in any group the inverse ⑻ of (a) is uniquely de¬ 
termined. As usual we write ⑹ = (a)— 1 . 

We return now to the consideration of finite dimensional vec¬ 
tor spaces. Let {e u e 2y …， e n ) and (九/ 2 ， …， fn) be ordered 
bases for the vector space 況 over A and, as before, let (a) be the 

* See，for example, these Lectures, Volume I, p. 24. 
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matrix of ( 力 ） relative to ⑹. Next let ( 《 1 ， g 2i … ， g n ) be a 
third ordered basis and let 

^11 P 12 * * * Pi 

卢 21 々22 • • • 卢 2 

• • • • • 9 

3nl 3n2 • • • 3nn 

be the matrix of (^ 1 , g 2y • • • ， A) relative to (/i，/ 2 , • . • ， / n). Then 

Si ^ ^jk^fk* SlIlCC f^ ^/(X]ci 6 iy 

gj = ^^jkfk = 卻 jkajciei = ^yjiei 
where yji = ^ ^jkocki- This shows that the matrix of (^ 1 , g 2j 

k 

• • •， gn) relative to {e Xy e 2y …， e n ) is the product ⑻ (a) of the 

matrices Q3) and (a). If, in particular, gi = then is 

the matrix of the (e iy e 2y •••， e n ) relative to e 2y •••， e n ). 
Since ei = it is evident that this matrix must be the identity 
matrix 1. Hence {0){a) = 1. By reversing the roles of (<? l5 e 2y 

• • • ， e n ) and (/ 1 ,/ 2 ，• • • y Jn\ we obtain also = 1. Thus 

we have proved 

Theorem 5. The matrix of any ordered basis (/ 1 ，九 .• 、 /n) 
relative to the ordered basis ( 心， e 2y • • • ， e n ) is non-singular. 

Conversely，let (a) be an element of L(A y n). Let (/3) = (a：) -1 . 
Define/» by fi = 2a" 勺 . Then we assert that (/i ， / 2 ，. • •，/ n ) is 
a basis for 9? over A. Thus the elements 

⑻ > : ^kiji = > : = > : ^kj^j 

• • • • 

» 1,3 3 

where 5 衫 is the Kronecker “delta;’ that is, d k j = 0 \f k 9 ^ j and 
=l if k = j. Thus 'SPkifi = and the are dependent on the 
/’s. Hence every x is dependent on the/’s. Thus the/’s are gen¬ 
erators. Since their number is they form a basis. 

We have therefore established a 1-1 correspondence between 
the different ordered bases and the units in A n : If ( 〜 e 2y … ， e n ) 
is a particular ordered basis, then every ordered basis is obtained 
by taking a unit (a) in A n and defining /《 = 2 叫办 

There is no difficulty, of course, in duplicating the above re¬ 
sults for right vector spaces. We need only to settle on the defi¬ 
nition of the matrix of x 2 \ … ， x/) relative to the basis 
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« ， • • • ， e n f ) for the right space 9J’. We do this by writing 
x/ = 'Ze/aij and by defining the matrix of « ， x 2 \ … ， x/) 
relative to (ei y e 2 \ ••• ， e n r ) to be (a). Thus in this case the 
matrix is the transposed * of the matrix which appears in the 
equations x/ = As before we obtain a 1-1 correspond¬ 

ence between the various ordered bases and the elements of 
L(A, n). 


EXERCISES 

1. Prove that, if (an, 0!l2, • • • ， «ln)j («21, «22, • . . ， «2n)j • . .，(«rlj «r2, . . • ， Oi rn ) 
are (left) linearly independent, then there exist i = r + 1， •••，《，j = 1, 2, 
•••，》，such that (a) = (an) is a unit. 

2. Let A be a finite division ring containing q elements. Show that the num¬ 
ber of units in A n is 


N = {q n — 1) (q n — q) ••- {q n — q 71 - 1 ) • 

7. Applications to matrix theory. The correspondence between 
bases and units in A n enables us to apply our results on bases to 
obtain some simple but non-trivial theorems on matrices with 
elements in a division ring. We prove first the following 

Theorem 6. If (a) and (/3) e A n and (13) (a) = 1, then also 
(a)(13) = l so that (a) and (0) e L(A, n). 


Proof. If (/3)(a) = 1， the equation (8) shows that if fi = 
'Eaijej, then the are dependent on the/’s. The argument given 
above then shows that the /’s form a basis. Hence the matrix 
(a) of (/i ， / 2 ，. • . ， A) relative to (e ly e 2y • • •， e n ) is a unit. Since 
the inverse is unique, it follows that ⑹ =(a) -1 . 

Theorem 7. If (a) is not a right {left) zero divisor in A ny then 


(a:) 8 L(A, n). 

Proof. We have to show that the vectors fi = 'Zaijej form a 
basis. By Theorem 4 it suffices to show that the/’s are linearly 
independent. Suppose therefore that = 0. Then 2/3 汾的 

= 0 and hence = 0 for j = 1 ， 2 ， • • • y n. Thus if 


r/5i 


⑻ = 


o 


"2 

0 


0 



0 


* The transposed of the matrix (a t j) is the matrix with element aij in its (J t /)-position. 
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then (jS)(a) = 0. Since (a) is not a right zero divisor，this im¬ 
plies that (jS) = 0. Hence each ft = 0. This proves that the 
fi are linearly independent and completes the proof for the case 
in which (a) is not a right zero divisor. The proof for the case 
(a) not a left zero divisor can be obtained in the same way by 
using right vector spaces. The details are left to the reader. 

We shall obtain next a set of generators for the group L(A y n). 
Consider the matrices of the form 





D P (y) 


7 9^0 
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in which the elements not indicated are 0. We call these matrices 
elementary matrices of respective types I ? II and III. These ma¬ 
trices belong to L(A y n)\ for T V q{0)~ 1 = T vq { — 0), D v {y)~ l = 
D p {y~ l ) and P p q— i= P pq . We shall now prove the following 

Theorem 8. Any matrix (a) in L(A y n) is a product of elemen¬ 
tary matrices. 

Proof. We note first that, if (/i ， 九 … ，入 ） is an ordered 
basis, then so are the following sets: 

X ， f 2 ， • • * y fp—ly fp yfp + ly . fp 七时 q ， 9. ^ P 

C/l ， /2, • • . ， /p-l ， /p’ ， /p+l ， • • 'yfn)y fp = jfp, 7^0 

(fu - - 'yfp-u/pyfp+ly •• • • ， /g-l ， /g’ ， /g+l ， …， / n )， 



Moreover, the matrices of these bases relative to (/i,/ 2 , •- •，/ n ) 
are elementary matrices of types I ， II， or III. 

Now let (a) be any matrix in L(A, n) and define fi = ^a^ej 
where the e’s constitute a basis for an n dimensional vector space. 
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Then ( 九 / 2 ， • • •，/ n ) is an ordered basis. We wish to show that 
we can go from this basis to the basis (e ly e 2y … ， e n ) by a sequence 
of “elementary replacements” of the types indicated above. 
This is trivial if « = 1, and we can suppose that it has already 
been proved for {n — 1) dimensional vector spaces. Now the fi 
cannot all belong to [e 2y e Sy … ， e n ]. Hence one of the an y say 
is 〆 0. We interchange fuf p to obtain the basis (//, / 2 , 
• • . ， / P —i ， /p’ ， /p，. • •，/ n ) in which // has a non-zero coefficient 
for ei in its expression in terms of the ei. Next we replace / 2 by 
/ 2 * = f 2 + where P is chosen so that / 2 * e [e 2y e Sy • • • ， e n ]- 
A sequence of such elementary replacements yields the basis 
(/i’ ， / 2 * ， / 3 *，•••，//) where the/i* c [e 2y e 3y • • •, e n ]. The vec¬ 
tors / 2 *,/ 3 *, • • - ,/ n * are linearly independent so that they con¬ 
stitute a basis for [^ 2 > ^ 3 , … ， ^n]- Hence by the induction as¬ 
sumption we can pass by a finite sequence of elementary replace¬ 
ments to the basis (//, e 2y e 3y … ， e n ). Next we obtain \ e 2 , 
e 3y … ， e n ) in which/i 〃 == fi + ^e 2 does not involve e 2 - A finite 
sequence of such replacements yields (yei, e 2y … ， e n ) and then 
(G，• • • ， ^n). We can now conclude the proof; for the ma¬ 
trix (a) of the basis (/i ， / 2 ，• • .，/ n ) relative to the basis (e ly e 2y 
is the product of the matrices of successive bases in our 
sequence, and these are elementary matrices. 


EXERCISES 

1. Express the following matrix as a product of elementary matrices 

- 2 -1 1 -li 

- 5-3 1 1 

2 3-1 0 

- 一 3 — 1 0 1 - 

2. Verify that 


0 r 


-1 1- 


「 1 0 i 


1 r 


-1 O' 

.1 0 . 


-0 1. 


--1 1 . 


-0 1 - 


- 0 1 . 


Generalize this result and use the generalization to prove that the elementary 
matrices of types I and II suffice to generate L(A y n). 

r5 0 

3. Prove that, if 5 〆0 ， , is a product of elementary matrices of type 

.(J A 丄 


1. Hence prove that any matrix in L(A y n) has the form (l3)D n (y) where (fi) is a 
product of elementary matrices of type I and D n (y) is defined above. 
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8. Rank of a set of vectors. Determinantal rank. Let S = 

(x a ) be an arbitrary subset of the vector space 9? and as before 
let [S] denote the subspace spanned by S, If x 2y • . •， x r ) is a 
maximal linearly independent set of vectors chosen from the set 
then every vector in S and hence in [S] is linearly dependent 
on the Xi ， Hence (xi y x 2 , • • •， x r ) is a basis for [S], The theorem 
on invariance of dimensionality now shows that r is uniquely de¬ 
termined by S y that is，any two maximal linearly independent 
subsets of a set S have the same cardinal number. We call this 
number the rank of the set S. Of course, the rank r Is < n and 
r = n if and only if [S] = 9?. These remarks show in particular 
that, if S = © is a subspace，then © = [S] is finite dimensional 
with dimensionality < n. Moreover dim ^ = n only if @ = SR. 

We shall now apply the concept of rank of a set of vectors to 
the study of matrices with elements in a division ring A. Let 
(a) be an arbitrary r X n matrix with elements in A and let (e ly 
e 2y • • •， e n ) be an arbitrary ordered basis for We introduce 

n 

the row vectors Xi = ^ a tj e Jy 1 — 1，2， • • •，r，of 9? and we define 

y=i 

the row rank of (a) to be the rank of the set ％ r ). A 

different choice of basis yields the same result. For, if (/^ / 2 , 
* * * 3 fn) is a second basis for 9? (or for another "-dimensional 
space)，then the mapping 2 匕 a. —> 2^/ z - is an equivalence which 
maps Xi into yi = Sa^./y. Hence dim x 2y - • • y x r ] = dim [y ly 

力， •. .，姑 

In a similar fashion we define the column rank of (a). Here 
we introduce a right vector space 況’ of r dimensions with basis 
(ei\ e 2 \ • • •， e r f ). Then we define the column rank of (a) to be 
the rank of the set x 2 \ • • •， x n f ) where x/ = Xe/aji ， The 
x/ are called column vectors of (a). We shall prove in the next 
chapter that the two ranks of a matrix are always equal. In 
the special case A = $ a field (commutative) this equality can 
be established by showing that these ranks coincide with still an¬ 
other rank which can be defined in terms of determinants. 

We recall first that a minor of the matrix (a)，in 中， is a de¬ 
terminant of a square matrix that is obtained by striking out a 
certain number of rows and columns from the matrix (a). For 

example, the minors of second order have the form • 
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We say that (a) has determinantal rank p if every (p + 1)-rowed 
minor has the value 0， but there exists a p-rowed minor 〆 0 in 
(a). The following theorem will enable us to prove the equality 
of row rank and determinantal rank. The proof will make use 
of well-known theorems on determinants. 

Theorem 9. The vectors Xi = i = 1, 2 y r，are lin¬ 

early independent if and only if (a) is of determinantal rank r. 

Proof. Evidently the determinantal rank p < n. Also the x f s 
are linearly independent only if r < n. Hence we may assume 
that r < n. Suppose first that the x，s are dependent，so that， 
say, = I3 2 x 2 + … + (3 r x r . Then = /3 2 a 2 y + + … + 

p r a r j for j = 1，2 ， • . • y n. Hence 

- r r r 

S ^kOiJcl S Pk0^k2 S PkOCkn 

2 2 2 

(a) = a 2 i a 2 2 • • • a 2 n 

參 • • • • 參 

‘ OL^\ • • • OLffi 

Since the first row of any r-rowed minor is a linear combination 
of the other rows, each r-rowed minor vanishes. Hence p < r. 
Conversely, suppose that p < r. It is clear that the determinan¬ 
tal rank is unaltered when the rows or the columns of (a) are 
permuted. Such permutations give matrices of the x y s in some 
other order relative to the es in some other order. Hence there 
is no loss in generality in assuming that 

"«11 «12 … «lp 

a 2 i a 2 2 •… « 2 p 

= 

• • 套參鲁 • 

^Oipi a P 2 … OLpp 

Now let i — 1，2， •. •，p + 1， be the cofactor of c^, p+1 in 




OLll «12 

汉 21 a 22 

• 參 

a p+hl a p+l,2 


a hp+l 

以 2,p+l 

^p+l,p+l 
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Then 〆 0 and Piaij + ^ 2 ^ 2 j + • • • + ft+i^p+i,y = 0 for 

j = 1 ， 2， •••，"• Hence /3iXi + /3 2 x 2 + … + /3 p+1 x p+ i = 0 where 
jS p+ i ^ 0. Thus the x y s are dependent. This completes the proof. 

Again let r be arbitrary and assume that the vectors x ly x 2y 
• • 、 x p form a basis for the set of x y s. Then by the above theo¬ 
rem there exists a non-vanishing p-rowed minor in the first p 
rows of (a). Moreover, since any p l x f s are linearly depend¬ 
ent, every p + 1-rowed minor in (a) vanishes. Hence the de- 
terminantal rank equals the row rank p. If we apply the same 
arguments to right vector spaces，we can show that the column 
rank and the determinantal rank are equal. As a consequence ， 
we see that in the commutative case the two ranks (row and 
column) of a matrix are equal. 

We have seen that the matrix (a) e n) if and only if the 
row vectors ( 〜 x 23 • • • ， x n ), Xi = 2o^.，form a basis for 9?. The 
latter condition is equivalent to the statement that the row rank 
of (a) is n. Hence the above result shows that (a) 8 L(^ y n) if 
and only if the determinant of this matrix is not zero in This 
result can also be proved directly (cf. these Lectures，Volume I ， 
p. 59). As a matter of fact, the inverse of (a) can be expressed 
in a simple fashion by means of determinants in the following 
way. Let Aij be the cofactor of the element aji in (a) and set 
0ij = Aij[dtt (a)] -1 . Then (fty) = (a) -1 . This follows easily 
from the expansion theorems for determinants. A proof is given 
in Volume I, p. 59. 


EXERCISES 

1. Prove that if A = $ is commutative and the elements are all different, 
then 


is in Z,($, n). 
determinant. 


•1 

«1 

ai 2 

… a\ n 

-1 ， 

1 

«2 

«2 2 

… «2 n 

-1 

• 

-1 

• 

Oifi 

OL n 2 

• • • • 

• • • (y n 

-1 


(Hint: The determinant of this matrix is a so-called Vandermonde 

Prove that its value is Jl(ai - ay).) 

• 、 * 


2. Prove that if △= 中 is a field and (a) 8 L($, n), then the transposed matrix 
(aYe L(^, n). 

3. Prove the following converse of Ex. 2: If (a) f e L(A, 2) for every (a) e L(A y 2), 
then A is a field. 
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4. Calculate the inverse of 

■1 —1 2 3 - 

0 1-11 
2 1 1 0 

.3 -5 1 7 . 

9. Factor spaces. Any subspace © of 9? is, of course, a sub¬ 
group of the additive group dt. Since dt is commutative, we can 
define the factor group 沉 = 9l/@. The elements of this group 
are the cosets x = x + and the composition in 淠 is given by 

x y = x + y. 

Now let a be any element of A. Then if x = y (mod ©)，that is, 
x — y = z e also az e 0; hence ax = ay (mod ©)• Thus the 

coset ax is uniquely determined by the coset x and by the ele¬ 
ment a e A. We now define this coset to be the product ax y 
and we can verify without difficulty that ^ A and the composi¬ 
tion (a, x) ax constitute a vector space. We shall call this 
vector space the factor space of 9? relative to the subspace ©. 

Now let (/i, f 2 y … ， /r) be a basis for ©. We extend this to 
a basis (/i,/ 2 , - - . ， /r ， /r+i ， • • . ， /n) for 況 ， and we shall now show 
that the cosets f r +u •••，/« form a basis for 尕 = 9?/©. Let x 

n n n _ 

be any coset and write x = ^2 a ifi\ then x aifi = a ifi 

l li 

=X a i/i = Z) a Jj since 7i = 0 for i < r. Thus (/ r+1 ，… -J n ) 

1 r + l 

n 

is a set of generators for On the other hand，if 23 ft./y = 0, 

r + l 

n nr 

then 2 8 © and so ^ ft/y = Z) 7k/k- This implies that all 

r+l r+l 1 

the = 0. Thus (/r+i，• • *>/n) is a basis. We have therefore 
proved that the dimensionality of 尕 is the difference of the di¬ 
mensionalities of 9?and of ©. 

10. Algebra of subspaces. The totality L of subspaces of a 
vector space 況 over a division ring A constitutes an interesting 
type of algebraic system with respect to two compositions which 
we proceed to define. We consider first the system L relative to 
the relation of set inclusion. With respect to this relation Z# is a 
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partially ordered set ， By this we mean that the relation ©i 2 ©2 
is defined for some pairs in L and that 

1 . © 3 

2 . if @1 3 ©2 and © 2 3 @ 1 ， then @1 = @ 2 ， 

3. if @1 3 @ 2 and © 2 2 © 3 , then 0 ! 2 © 3 . 

Thus the relation is reflexive, asymmetric and transitive. 

Consider now any two subspaces ©1 and @ 2 . The logical in¬ 
tersection @1 fl ©2 is also a subspace，and this space acts as a 
greatest lower bound relative to the inclusion relation. By this 
we mean that ©1 fl @ 2 is contained in @1 and @ 2 ， and @1 fl @ 2 
contains every & which is contained in and © 2 - The set 
theoretic sum @1 U @ 2 of two spaces need not be a subspace. 
As a substitute for this set we therefore take the space [©1 U @ 2 ] 
spanned by the set @1 U © 2 . We denote this space by ©1 + © 2 
and we call it the join of @1 and © 2 - It has the properties of a 
least upper bound: @1 + @2 3 ©1 and @ 2 ，and ©1 + ©2 is con¬ 
tained in every subspace @ which contains @1 and © 2 - It is 
immediate that these properties characterize @1 + © 2 ， that is, 
any subspace that has these properties coincides with @1 + @ 2 - 
Also it is immediate from this characterization or from the defi¬ 
nition of ©1 + ©2 as [ 0 i U @ 2 ] that this space is the set of vec¬ 
tors of the form y x + y 2 where the yi z 

A partially ordered set in which any two elements have a 
greatest lower bound and a least upper bound is called a lattice. 
Hence we call L the lattice of subspaces of the space 9 ?. In this 
section we derive the basic properties of this lattice. First we 
note the following properties that hold in any lattice. 

1 . The associative and commutative laws hold for the compo¬ 
sitions fl and +. 

These follow easily from the definitions. The rules for fl are, 
of course，familiar to the reader. 

We note next some special properties of the lattice L. 

2. There exists a zero element in L y that is, an element 0 such 

that _ , 

@ 门 0 = 0 and © + 0 = © 

for all ©. 

* Cf. Volume I, Chapter VII, for the concepts considered in this section. 
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The subspace consisting of the 0 vector only has these proper¬ 
ties. Dually the whole space 況 acts as an “all” element in the 
sense that 

@ + 況=況 and ©PI 況 =@ 

for all ©. 

The distributive law 6 fl (©2 + © 3 ) = ©i fl ® 2 + ©i 门 ©3 
does not hold without restriction in L. For example，let X\ and 
x 2 be independent vectors and set ©i = [^i], ©2 = [^ 2 ] and ©3 
=[xi + x 2 ]- Then @ 2 + @3 = [^i> ^ 2 ] so that ©1 D (@ 2 + © 3 ) 
=On the other hand, @1 D @ 2 and ©i fl @3 = 0 so that 
©1 门 ©2 + ©1 门 @ 3 = 0 . We shall show that a certain weak¬ 
ening of the distributive law does hold in L. This is the follow¬ 
ing rule: 

3. If ©1 ^ then fl (@2 + © 3 ) = ©1 门 ©2 + ©1 fl © 3 

=@2 + ©1 n ©3. 

Proof. We note first that ©1 fl @ 2 G ©1 门 （©2 + ©3) and 
@1 fl @3 G ©1 fl (®2 + @ 3 ). Hence 

©i 门 ©2 + ©1 n ©3 g ©1 门 （©2 + ©3). 

Next let z e ©1 fl (@ 2 + © 3 ). Then z = jy x in @1 and z = y 2 + 
y 3 where y 2 and y 3 are in @ 2 and © 3 respectively. Hence jy 3 = 
JVi — J 2 e ©1 + ©2 = ©i. Thus jy 3 e ©1 fl © 3 and 2 = jy 2 + jy 3 e 
©2 + ©1 门 © 3 . This proves that @1 fl (©2 + ©3) £ ©2 + ©1 
门 @ 3 . Hence 3. holds. 

A lattice in which 3. holds is called a modular (or Dedekind) 
lattice. We shall show next that L is a complemented lattice in 
the sense that the following property holds : 

4. For any @ in L there exists an in L such that 

© + @* = 況 ， @ n ©* = o. 

Proof. If (fu f 2 y • • . ， /r) is a basis for @，these vectors are 
linearly independent and can therefore be supplemented by vec¬ 
tors fr+u " 'yfn to give a basis {f u f 2y • • • ， 入 ） for 沉 • We set 

©* = [/r+l,/r + 2, ** • ， / n]. Then © + © * = [A，/ 2 , • • • ， A ]= 队 

Moreover, any vector jy in © (1 ©* is linearly dependent on f ly 

y* 2 ，• • * y f r and on y* r +i ， yV+ 2 ，• • * > f n* Since/i ， y* 2 ，• • * y fn lin¬ 
early independent, this implies that y = 0. Hence @ fl ©* = 0. 
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A subspace @* satisfying the above condition is called a com¬ 
plement of the subspace © in 9?. We note finally that the follow¬ 
ing chain conditions hold in L: 

5. If @1 2 @2 2 ••- is an infinite descending chain of sub¬ 
spaces, then there exists an integer r such that @ r = @ r +i = . • •• 

If ©i £ @2 S * * * is an infinite ascending chain of subspaces 
then there exists an integer r such that @ r = @ r+1 = . • •• 

Both of these are clear since the dimensionality of a subspace 
is a non-negative integer * and since @implies that dim © 
> dim 

EXERCISES 

1. Prove that, if ©i U @2 = ©1 + © 2 ，then either @1 3 @2 or @2 ^ ©i. 

2. Prove that, if dim © = r, then the dimensionality of any complement is 
n — r. 

3. Prove the general dimensionality relation: 

dim (@1 + © 2 ) = dim ©1 + dim ©2 — dim (@1 门 © 2 ). 

4. Show that if © is any subspace 9^ 0 and 〆 9?, then @ has more than one 
complement. 

11. Independent subspaces, direct sums. We consider next a 
concept which we shall see is a generalization of the notion of 
linear independence of vectors. Let @ 2 ，. • •，be a finite 
set of subspaces of 9?. Then we say that these subspaces are in¬ 
dependent if 

( 9 ) ©i D (@1 + . • • + @ l -_ 1 -f- @f + i + . . . + @ r ) = 0 

for / = 1 ， 2 ， … ， r. If x ly x 2y • • •, x r are vectors in dt, then 

necessary and sufficient conditions that linear independence holds 

for these are: 1) 〆 0 for / = 1 ， 2 ， … ， r; 2) the spaces [x{] are 

independent. Thus suppose that 1) and 2) hold and let 2/5 而 = 0. 

Then —^iXi = 8 [ x i\ ([^ 1 ] + • • . + [^z_i] + [^V+i] + • • • 

w 

+ [x r ]). Hence by 2) ， —(3iXi = 0. Since Xi 9 ^ 0, this implies 
that each ft = 0. Next assume that the Xi are linearly independ¬ 
ent. Then certainly each Xi 9 ^ 0. Furthermore ，if x e [x^ fl 
([^ 1 ] H - h [A-i] + [x i+1 ] H - h [x r ])y then x = 以 = 

* We assign to the space 0 the dimensionality 0. 
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^2 Hence by the linear independence of the %’s，ft = 0 

and so ^ = 0. 

Let ©i ， @ 2 ，…， ©r be arbitrary independent subspaces and 

set @ = @1 + @2 + • • • + ©r- If jy e ©，J = JVl + )2 + • • • + 
y r where yi e @ z -. We assert that this representation is unique, 
that is, if y = Ji’ + 力 ’ + … + Jr where y/ e then = y/, 
i = 1 ， 2,… ， r. Thus if then Hzi = 0 for %i = yi — 

in @ 4 -. Then 

—Zi = e @1 H (©1 + • • • + ©i 一 1 + ©t + 1 + • • • + ©r). 

Hence Zi = 0 and yi = y/. The converse of this result holds 
also; for if (9) fails for some /， then there is a vector Z{ 〆 0 in 
this intersection. Thus ^ Zj y and we have two distinct 

j 尹 i 

representations of this element as a sum of elements out of the 
spaces ©*• We have therefore proved 

Theorem 10. A necessary and sufficient condition that the spaces 
© 1 ， @ 2 ， … 、泛 T be independent is that every vector in © = ©i + 
©2 + • • • + ©r have a unique representation in the form 2jy^ yi in 

A second important characterization of independence of sub¬ 
spaces is furnished by 

Theorem 11. The spaces are independent if and only if 
dim (@i + @2 + • • • + © r ) = 2 dim 0^. 

Proof. Suppose first that the are independent and let 
(fiiy/ 2 iy - - . ， /n。）be a basis for @ z -. Then if 2^-/^ = 0, Sjy,- = 0 
where yi = ^jifa e ©f- Hence for each i y 0 = jy z - = 2^-/^. 

3 

Then 如 = 0 since the fji for a fixed i are linearly independent. 
This proves that all the/’s are linearly independent. Hence the 
/’s form a basis for © = @i + ©2 + * * * + Their number 
where ni = dim is the dimensionality of ©. Thus 
dim @ = 2) dim ©*. Conversely suppose that this dimensionality 
relation holds and, as before，let the fa form a basis for The 
number of these /’s is 2 dim = dim ©. On the other hand ， 
these fji are generators for It follows that they form a basis, 
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and consequently they are linearly independent. It follows di¬ 
rectly from this that，if 'Lyi = 2jy/， y/ in then yi = y/. 
Hence the are independent. 

If 況 2 ， • • are independent subspaces and 9? = 9?i + 
況 2 + • • • + 9?r，then we say that 9i is a direct sum of the subspaces 
dti- We indicate this by writing 況 = 9?i ㊉況 2 ㊉… ㊉況 r. If 
this is the case, every vector of can be written in one and only 
one way as a sum of vectors in the subspace 

EXERCISES 

1. Prove that the following are necessary and sufficient conditions that the 
subspaces be independent. 

0 ! n @2 = o, (@i + @ 2 ) n @3 = o, 

(@1 + @2 + ©3) 门 @4 = 0 , • • • • 

2. Prove that if 9? = 9?i ㊉ 況 2 ㊉…㊉ 队 and each ㊉…㊉9? 加， 

then 9? = 9?11 ㊉ • •. ㊉ 9?lni ㊉ 況 21 ㊉ ... ㊉ 9?2n 2 ㊉ • ••㊉ 9?m r * 



LINEAR TRANSFORMATIONS 


In this chapter we discuss the simplest properties of linear 
transformations and of certain algebraic systems determined by 
these mappings. Two particular types of linear transformations 
are of special interest, namely, the linear transformations of a 
vector space into itself and the linear transformations of a space 
into the one-dimensional space A. The former type constitute 
a ring while the latter，called linear functions, form a right vec¬ 
tor space. There is a natural way of associating with a linear 
transformation of the vector space into the vector space 5R 2 
a transposed linear transformation of the conjugate space of linear 
functions on 5R 2 into the conjugate space of 5Ri. We consider 
the properties of the transposition mapping. The relation between 
linear transformations and matrices is discussed. Also we de¬ 
fine rank and nullity for arbitrary linear transformations. Finally 
we study a special type of linear transformation called a projec¬ 
tion, and we establish a connection between transformations of 
this type and direct decompositions of the vector space. 

1. Definition and examples. The differentiation mapping 
0(X) —> 0’(X) in the vector space $[X] of polynomials with real 
coefficients has the properties 

[0(入） + 0(入)]’ = 0 ’(入） + 沴 ’(入)， M >0)]’ = a0 ’ O ). 

This is an example of a linear transformation. Another example 
is the mapping of A (3) defined by 

(S> Vy T) — ?入 + + > 
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where 入， m ，p are fixed elements of the basic division ring A. In 
general, let dti and 9? 2 be vector spaces over the same division 
ring A. Then we call a mapping A of into 9f 2 a linear trans¬ 
formation if 

(1) {x + y)A = xA + (ax) A = a{xA) 

for all y in and all a in A. As usual xA denotes the image 
in 況 2 of the element x. We shall also denote the image set，that 
is，the set of images xA, by 9?〆. The statement that ^ is a 
mapping into dt 2 allows the possibility that cz $K 2 (i.e. 
is a proper subset of 9? 2 ). 

The concept of linear transformation is a special case of that 
of o-homomorphism of one o-module into a second one. The 
generalization is obtained by replacing “a in by “a in o” in 
the above definition. It may be recalled that o-homomorphisms 
which are 1-1 have been introduced in Chapter I. Such mappings 
have been called equivalences or o-isomorphisms. The existence 
of an o-isomorphism of onto 況 2 is our criterion for equivalence 
of the modules 

The first condition in (1) states that yf is a homomorphism of 
the additive group into the additive group 9? 2 while the sec¬ 
ond can be interpreted as a type of commutativity of A with a. 
This is strictly the case when 9^ = 9? 2 = 沉 ； for we can introduce 
for each a the mapping a\ which sends x into ax. We call ai the 
scalar multiplication determined by a. It is clear that ai is an 
endomorphism of 況 ， that is，a homomorphism of 沉 ， regarded as 
a group，into itself. Now x{a z A) = {ax)A and x{Aai) = a{xA)\ 
hence ^ is a linear transformation in the vector space 況 if and 
only if A is an endomorphism of 9? which commutes with all the 
endomorphisms ai ， 

Besides the linear transformations of a vector space into itself 
a second noteworthy type of linear transformation is a linear 
function. This is defined to be a mapping x —> f{x) of a vector 
space into the division ring A such that 

(2) f(x + y) =f(x) +f(y) y /(ax) = af(x). 

It is clear that a mapping of this type can be regarded as a linear 
transformation of 9? into the one-dimensional vector space △. 
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The latter is obtained by using the additive group of A as group, 
A as division ring and left multiplication as multiplication by 
scalars. The element 1 (or any non-zero element) is a basis for 
△ over A. The second example considered above is an instance 
of a linear function on A (3) . 

EXERCISES 

1. Show that the differentiation mapping 沴( 入） — 0’ ( 入） is a linear transforma¬ 
tion in the vector space 9? of polynomials of degree <n. 

2. Show that the difference operator —> <f)(X + 1) — 0( 入） is a linear trans¬ 

formation in $ [入] • 

2. Compositions of linear transformations. We consider now 
ways of combining linear transformations. It should be remarked 
that all the results of this section apply equally well to the more 
general case of o-homomorphisms of modules. However, for the 
sake of simplicity we shall state the results only for the special 
case that is of primary interest in the sequel. 

Suppose first that A and B are linear transformations of a vec¬ 
tor space 況 i into the same space 況 2 . We define a mapping 
A + B of dti into 況 2 by the equation 

(3) x{A + 5) = xA + xB 

for any x in 9?i， Thus to obtain the effect of yf + 5 on % we add 
the images xA and xB. Clearly + 5 is a (single-valued) trans¬ 
formation of 沉 i into 9? 2 . Since 

(x + y)(J + B) = (x + y)A + (^ + y)B = xA + y-A + xB + yB 

=xA + xB - yA yB = + B) y{A + B) 

and 

{ax){A + B) = {olx)A + {ax)B = a{xA) + a{xB) 

= a{xA 4 - xB) = <x{x{A + B)) y 

J + jB is a linear transformation of into 況 2 . 

We now denote the totality of linear transformations of 9?i 
into 況 2 by S(5Ki， 況 2 )， and we shall show that this set，together 
with the addition composition just introduced，is a commutative 
group. We note first that the associative and commutative laws 
hold; for we have the following relations : 
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x\{A + E) + C] = x{A + B) + xC = xA + xB + xC y 

-f- (5 C)] = xA -f- x{B H~ C) = xA -f* xB xC y 

x{A + B) = xA + xB y x(B - A) = xB + xA, 

Thus {A B) -\- C and A -{B C) have the same effect on 
any x in 9? l5 and this is what is meant by saying that the trans¬ 
formations A {B C) and (^4 + B) + C are equal. Simi¬ 
larly A + B = B + A. Next we define the mapping 0 by the 
condition = 0， the zero vector in 9? 2 - It is immediate that 
this mapping is in 沉 2 ) and that A 0 = A — 0 + A for 
all A in 9? 2 ) - Hence 0 acts as identity element for the ad¬ 

ditive composition. Finally, if A is any member of 2(3?i， 沉 2 ) 
we define — yf to be the mapping such that x{ — A) = —xA. It 
is easy to verify that —A e 9 ? 2 ). Moreover, —A acts as 
the inverse of A since x{A + { — A)) = xA — xA = 0 for all 
This completes the verification that ?(況 1 ，況 2 )， + is a commuta¬ 
tive group. 

We introduce next a second composition for linear transforma¬ 
tions. This is defined for any A in ?( 9 ?i，9? 2 ) and any B in 
?(況 2 ,況 3 )，and it is taken to be the resultant of A followed by B. 
As usual，we denote the resultant as AB. Hence by definition 
x{AB) = (xA)B. Consequently 

(x - y){AB) = {{x y)A)B = {xA + yA)B = {xA)B + {yA)B 

= x{AE) + y{AE) 

and 

{ocx)^AB) = {(ax)A)B = {a{xA))B = a{{xA)B) — a{x{AB)). 

This shows that AB e 況 3 ). 

As is well known, the product AB is an associative one，that 
is, ifJe 2(dt u dt 2 )y B e dt 3 ) and Ce 況 4 )，then 

(4) {AB)C = 

for 

x{{AB)C) = {x{AB))C = ((xJ)B)C 

and 

x{A{BC)) = {xA){BC) = 
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We prove next the important distributive laws: If A e S( 9 ii , 況 2 )， 
B y C e 2 ( 9 { 2 , 況 3) and D e S( 5 R 3> 況 4 )， then 

( 5 ) A{B + C) = JB + AC, {B + C)D = BD + CD. 

These follow from the following equations: 

x{A{B + C)) = {xA){B + C) = {xA)B + {xA)C 

= x(^AB) -f- x{AC) = x(^AB + AC) 
x{{B + C)D) = (xB + xC)D = (xB)D + {xC)D 

= x(BD) + x(CD) = x(BD CD). 

We now specialize the foregoing results to the case of the linear 
transformations in a single vector space 9?. It is clear that 
2 = S(9?, dt) y +， • is a ring ； for ?( 況，沉 )， + is a commutative 
group, 9f) is closed under •，and this composition is associa¬ 
tive and distributive with respect to addition. It is evident also 
that S contains the identity mapping x x and that this map¬ 
ping, denoted as 1 , is the identity in the ring S (i.e. A\ = A = \A 
for all yf).* 

Suppose next that 中 is the center of the ring A. Of course，$ 
is a subfield of A. We observe that the scalar multiplications 
yi determined by the elements 78$ are linear transformations; 
for, yi is an endomorphism and (ax)yi = y(ax) = (ya)x = (ay)x 
=a(yx) = a(xyi). Thus if denotes the set of multiplications 
by the elements 7 of 伞 ， then S 2 In particular if △= 中 is 
commutative, then 2 contains all the scalar multiplications. We 
now show that any of the groups S (況 1 ，況 2) can be regarded as a 
vector space over the field 屯 For this purpose we define 
for 7 in and A in 8( 況 1 ， 5 R 2 ) to be the mapping x —> y(xA )= 
{yx)A. Since this is the resultant of A and yi (in 9 ? 2 ) or of 7 i 
(in 9 ii) with A and each of these is linear ，yA is in S (況 1 ，況 2). It 

* A reader familiar with the theory of endomorphisms of a commutative group such as is 
given in Volume I, pp. 78-82, will note that these results can also be obtained by the follow¬ 
ing reasoning: The set @ of endomorphisms of 9i，+ is a ring relative to the addition com¬ 
position x{A + 5) = xA + xB and the multiplication composition as resultant. The set 
S = 5R) is the subset of © of elements commuting with the scalar multiplication ai ， 

Since the totality of elements of a ring commuting with the elements of a given subset 
form a subring, it is clear that 8 is a subring of 
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is easy to verify that the function yA satisfies the rules for mul¬ 
tiplication by scalars in a vector space. In this way we can re¬ 
gard 2 ( 9 ?i， 況 2) as a vector space over 中. 

If we combine the results of the last two paragraphs，we see 
that the set 2 = 2 ( 9 ?, dt) is at the same time a ring and a vector 
space over a field 中 . The ring addition is the same as the vector 
space addition. Moreover，we have the following relations con¬ 
necting multiplication and scalar multiplication: 

(6) y{AB) = {yA)B = 

A system having these properties is called an algebra (or hyper¬ 
complex number system) over the field Hence when we wish to 
study 2 relative to all three operations at the same time，we shall 
refer to this system as the algebra of linear transformations m 说 . 

EXERCISES 

1. Show that 9?2) is an 2(9?i ， $Ri)-module relative to the composition AX, 

A in S(9?i, 9?i), X in 9?2) as the resultant linear transformation. Similarly 

show that 9?2) can be regarded as a right ?( 況 2 , 9 ? 2 ) module. 

2. Prove that if ai is a linear transformation, then a is in the center $ of A. 

3. Verify that, if C e ?(9?2, 9?2) and X e S(9?i, 況 2 )， then the mapping X —> XC 
is an 2(9?i, 9?i) endomorphism of ?(9?i ， 9?2). 

3. The matrix of a linear transformation. We shall now show 
that a linear transformation of one finite dimensional vector space 
9 ?i into a second finite dimensional space 9? 2 can be completely 
described by means of a finite matrix with elements in the under¬ 
lying division ring A. 

Let SRi, i = l y 2 , be rii dimensional，let {e u e 2j • • •， e ni ) be an 
ordered basis for 9 ^， （/i，/2，. • •，/ n2 ) an ordered basis for 5 R 2 and 
let A e 2(dtiy 9 ? 2 ). We note first that the action of A on any x is 
determined by the images eiA^ / = 1 ， 2 ， • • •，Thus ^ can be 

ni 

written as X) 匕 A.. Hence xA = ( 2 ^^)^ = 

i 

Thus xA is determined by the expression for x and by the images 
e{A. Now write 

( 7 ) e{A = OLilfi + OL i2 f2 + • • • + ^in 2 /n 2 y = 1 ， 2 ， • • • ， ” 1 . 
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Then we obtain the matrix 



仅 11 

«12 

… «ln 2 

⑻ 

«21 

«22 

• • • «2n 2 

• 

• 





* ^n\ni 


as the matrix of • • .， e ni A) relative to (/i ，•- •，/ n2 ). Clearly 

if the two ordered bases and the matrix ( 8 ) are known, then the 
effect of A on any x can be deduced; for ( 7 ) holds and as we 
have seen xA = z ⑽ u 

This connection can be expressed in terms of matrix multipli¬ 
cation as follows. Write x = 2 匕 a. as a row (L，$ 2 ，• • $ W1 ) and 

similarly y = 2 ^/y as (rji, rj 2y ...，r； n2 ). Then the “row vector” 
associated with y = xA is obtained by performing the matrix 
multiplication: 




«11 

戊 12 

… «ln 2 

⑼ 

(专 1 ，会 2， • • •，D 

«21 

參 

a 2 2 

• 

… OL 2n2 

• • m ♦ 



-^nil 

^ni2 

* ^n\ri2 


Thus xA = y = where rjj = 2 匕叫， and this is what we ob¬ 

tain from ( 9 ). 

It should be emphasized that the matrix (a) depends on the 
choice of bases in the two spaces. For this reason we call (a) 
the matrix of A relative to the ordered bases (e iy e 2y • • •， e ni ) and 
(/i，/2，• • • ， • If 9 ?i = 9?2 = 況， then it is natural to use just 
one ordered basis, that is, to take the fi = e{. In this case we 
refer to (a) as the matrix of A relative to (ei y e 2j • • •， e n ). 

The result that we have obtained is that any A e 8 ( 況 1 ， 9 ? 2 ) de¬ 
termines an ni X n 2 matrix with elements in A. We now note 
the converse: that any X n 2 matrix defines a linear transfor¬ 
mation of dti into 9 ? 2 . We note first that, if e 2y • • •， e ni ) is a 
basis in 9 ii and (ui y u 2y • • •，^ ni ) is an arbitrary ordered set of 
vectors in then there exists a linear transformation A map¬ 
ping ei into Ui for /• = 1 ，2， • • •，Thus consider the mapping 
2 匕 a- — ^iU{. Since there is only one way of writing a vector 
x as 2 专而， this mapping is single-valued and, since any 
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x edti can be written in the form 2 匕 a 、the mapping is defined on 
the whole of If y = is a second vector in y —> 

IjrjiUi and x y = 2 (匕 + rji)ei ― > 2 (匕 + rji)Ui = 2 $ 此 • + 2 ” 两 . 
Hence the transformation is a homomorphism. Moreover ， ax = 
X(a^i)ei = a(S^iUi) so that the mapping is linear. 

Clearly ei = —> \ui = Ui as required. Now let (a) be any 

ni X n 2 matrix and let (/i ， /2，• • .，/ W2 ) be a basis in 9 ? 2 . Then we 
define Ui = / = 1 ， 2 ， • • •，and we can determine a 

linear transformation A such that = Ui ， Evidently the ma¬ 
trix of A relative to (e u e 2y . . • ， e ni ) y (/i ， /2，• • . ，人 2 ) is the given 
matrix (a). We have, therefore, shown that the correspondence 
A (a) is 1-1 between 2 (dti y 9 ? 2 ) and the set of X n 2 ma¬ 
trices with elements in A. 


EXERCISES 

1. Let 3J be the vector space of polynomials of degree <n with real coefficients 
and let D denote the differentiation operator. Show that D is nilpotent in the 
sense that D n = 0. Determine the matrix of D relative to (1 ， 入 ， .• . ， X n_1 ) and 
also relative to (1, X/l!, .. •，\ n ~ l /(n — 1)!). 

2. Let 9? be as in 1. and let U be the linear operator/(X) —> /( 入 + 1). Prove 
that 


7 = 1 + 


D . D 2 


2! 


+ … + 


D 1 


.-i 


(n — 1)! 


3. Determine the matrix of 5 = t/ — 1 relative to the basis (eo y ei, 
where 

X(X 一 1) . • •( 入一 / + 1) 

eo = 1 , ei = --- 

t\ 


y — 1 ) 


4. Let 9? be the set of complex numbers regarded as a vector space over the 
subfield of real numbers. Show that the mapping x x (complex conjugate) is 
linear and determine its matrix relative to the basis (1, i). 


4. Compositions of matrices. As before，let 9 ^， i = 1 , 2 y be 
rii dimensional vector spaces over A and let e 2i … ， e ni ) y 
(/i ， /2，• • • ， /n 2 ) be bases for these two spaces. Let A and B be 
linear transformations of into 況 2 ，(«) and ⑹， respectively, 
their matrices relative to the given bases. Then 

(10) eiA = dB = 卻 ijfj. 

Hence 

(11) - B) = e{A + e{B = 2(w + 
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This shows that the matrix o{ A B \s obtained from the mat¬ 
rices (a) and ⑹ by adding elements in the same position. Ac¬ 
cordingly we define the sum of two X n 2 matrices (a) and ( 戸 ) 
as the matrix whose (^i)-element is a" + It is easy to 
verify that the set of X n 2 matrices is a commutative group 
relative to this addition. As a matter of fact, except for a differ¬ 
ence of notation, this is a special case of the result noted in Chap¬ 
ter I that the set of ^-tuples form a group under addition as 
addition of components. The 0 matrix is the matrix that has 0 
in every place，and — (a) has the element —aij in its (/, j) posi¬ 
tion. Now the result that we established in (11) — namely, that 
A ^ {a) and B — (/ 3 ) in the correspondence between linear 
transformations and matrices ， then A B {a) ( 13 ) — is 

equivalent to the statement that A —> (a) is a group isomor¬ 
phism. 

We consider next a third vector space 5 R 3 with basis (gi ， g2 y 
• • • ， <?n 3 ). Let C be a linear transformation of 9 ? 2 into 9? 3 and let 
(7) be the matrix of C relative to (/i,/ 2 , - - . ， / W2 ) ， g2y • • •， 
， W3 ). Then 

( 12 ) fjC = ^yjkgk 

so that 

( 13 ) ei{AC) = (oLijfj\C = Yj a nU)Q = H oiijy jk g k . 

\ 3 / 3 j,k 

This shows that the matrix of AC has the element ^2 in 

j 

its (/ ， 是 ) -position; hence this matrix is the product (a)(7) as de¬ 
fined in Chapter I. 

The associative law for matrix multiplication has been estab¬ 
lished before (p. 16 ). We now prove distributivity. The (/, k) 
element of [(a) + (/ 5 )](t) is 

Z (a" + 

j 

while the (/, k) element of (a)(7) + (18)(7) is 

S a ijyjk + 
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Hence by the distributive law in A, 

[(a) + ⑹] Or) = (a)( 7 ) + ⑹ O). 

Similarly we can verify that 

O ) [⑹ + (7)]= (戊)⑹ + ( a )(7). 

We remark also that it is easy to deduce the associative and dis¬ 
tributive laws for matrices from the corresponding laws for linear 
transformations (cf. Exercise 1 below). 

We note next that the set of X n 2 matrices with elements in 
A can be regarded as a vector space (or a right vector space) 
over A. This is clear since the set of matrices is essentially the 
same as the set of " 而 - tuples over A. As before，we define p(a) 
to be the rii X n 2 matrix whose elements are p times the corre¬ 
sponding elements of A. Clearly the vector space that we ob¬ 
tain in this way is nin 2 dimensional. If we use our correspond¬ 
ence between matrices and linear transformations, we can carry 
over this discussion to the set S(3Ji ， 9?2) of linear transformations 
of into 9?2. However, unless A = $ is commutative, the sca¬ 
lar multiplication in 8 ( 9 ^ ， 9? 2 ) obtained in this way depends on 
the choice of the bases in and 9 ? 2 . 

On the other hand，let △= 中 . 丁 hen，as we saw in § 2 , there is a 
way of defining a multiplication of linear transformations by ele¬ 
ments of $ which is independent of the choice of bases. The prod¬ 
uct y in is taken to be the resultant yiA. Relative to this 
composition ?(9?i ， 9? 2 ) is a vector space over 中 . We now note 
that，if (^i, e 2y …， e ni ) is a basis for then ecu = yei ， Hence 
the matrix of yi relative to this basis is the diagonal matrix 

y 0 

7 

(14) diag {7, y, • • •, 7 } = • 

-0 7 

Consequently if (a) is the matrix of A relative to (q ， e 2y …， e ni ) y 
C/i ， /2 ， • • .，/ n 2 )， then 7(a) is the matrix of relative to this 
pair of bases. This means that the scalar multiplication y{a) 
corresponds to 
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Another way of stating this result is the following. Let A 
{a) be the correspondence which associates with a linear trans¬ 
formation A 8 9?2) its matrix (a) relative to the bases {e u 

e 2y •••， e ni ) y (/i，/ 2 ， - - •，/ n 2 ) - Then this correspondence is an 
equivalence of the vector space ?($Ri， 況 2) onto the vector space 
of rii X n 2 matrices with elements in for we have seen that 
A —> (a) is a group isomorphism and we have just verified that 
—> y(a). Since the matrix space is w 1 ^ 2 -dimensional, it fol¬ 
lows from this that 2( 況 1， 9 ? 2 ) is ^i^ 2 -dimensional. This proves 
the following 

Theorem 1. Let 9 ^-， / = 1 , 2 , be rii-dimensional vector spaces 
over a field 电 and let 8(9?i，9J 2 ) be the set of linear transformations 
of dti into dt 2 - Define A and yA for y in $ as above. Then 
S(9ii， 沉 2) is an nin 2 -dimensional vector space relative to these 
compositions. 

We return now to the case of an arbitrary A, but we specialize 
by taking = 9 ? 2 = SR. Also we take the fi = ei so that (a) 
is now the matrix of A relative to the single basis (e l9 e 2y • • •， e n ). 
In this case we have a correspondence A —» (a) of the ring 
2 = 況） onto the set A n of n X n matrices. The addition 
and multiplication compositions introduced in A n turn this set 
into a ring. Also our results show that，if ^ (a), B (卢)， 

then A + B (a) + (/ 3 ) and AB (a) ( 13 ). Hence we have 

the important 

Theorem 2. Let 3J be an n-dimensional vector space with the 
basis (e iy e 2y • • •， e n ) over A. If A is a linear transformation in 
況 ， we associate with A its matrix (a) relative to the basis {e u e 2 , • • •， 
e n ). Then A —> (a) is an isomorphism of the ring 2 of linear 
transformations in dt onto the matrix ring A n . 

EXERCISE 

1. Prove associativity and distributivity of matrix multiplication by using the 
corresponding properties of multiplication of linear transformations. 

5. Change of basis. Equivalence and similarity of matrices. 

Let (a) be the matrix of A e 9 J 2 ) relative to the bases 
e 2 y • • •， e ni ), (fu/2y •- •，/ n 2 ). We now change the bases in dti 



42 


LINEAR TRANSFORMATIONS 


and and we shall calculate the matrix of A relative to the new 
bases. Thus let (ui y u 2y • • •， u ni ) be a second basis in dti where 
Ui = and let (t；i，> v n2 ) be a second basis in where 

v p = ^Ppq/q- The matrices (m) and {v) are non-singular, and we 
write their inverses as (ju) -1 = (M"*)，W— 1 = (%«*)• Now we 
have 

UiA = = 'E^ajp/p 

=XfJLijajpVpq^Vq = 'ZaiqVq 

where 

^■iq = > : 

J’，P 

Hence the new matrix of A is 

( 15 ) (a) = (m)(oOO) 一 1 

where (m) gives the change of basis in 9?i and where (v) gives the 
change of basis in 況 2 . 

Now we shall call two X n 2 matrices (a) and (a) equivalent 
(or associates) if there exist matrices (m) and {y) in L(A, ni) and 
L(A, n 2 ) respectively such that 

(16) (d) = (M)(a)0). 

Thus we see that any two matrices of the linear transformation 
A relative to different bases in the two spaces are equivalent. 
The converse is also clear. For let (a) and (a) be related as in 

( 16 ) and let A be the linear transformation whose matrix is (a) 
relative to (e ly e 2y …， e ni ) and (九/2, • • - 3 / n2 ). Then this linear 
transformation has the matrix (a) relative to (ui y " 2 ， • . •，" ni )， 

w 2y - - •, w n2 ) where 

Ui = w p = ^PQ^/gy W 一 1 = (^9*)- 

Assume next that 9 ?i = SR2 = 5 R and that e 2y • • •， e n ) is a 
basis. Let (a) be the matrix of A relative to (e ly e 2y •. •， e n ). 
Then dA = 2 a〆)，and our computation shows that the matrix 
of A relative to (ui y …， u n ) y is 

( 17 ) (a) = (m)(«)(m) _1 . 




where the f» are the n distinct nth. roots of unity, are similar in C n , C the field of 
complex numbers. We use (a:) to determine a linear transformation yf in an w 
dimensional vector space 9? over C. This is done by choosing a basis 
(ei y <? 2 , . • • ， <?n) in 9? and defining eiA = ^ a^ej = for i < n and = e\ for 

i = n. Then in order to prove our assertion, we must find a basis («i ，《 2 , • •. ， u n ) 
such that UiA = for the A that we have just defined. Without giving the 
details as to how one goes about finding such we shall show that the following 
Ui satisfy the requirements. 

Ui = + m + • • • + 

Thus 

UiA = e 2 + U~ l ez + … + U~ {n ~ l) ei = f 你， 

and the U{ form a basis since the matrix of («i, • • • ， u n ) relative to 

(ei, e 2 y • • . ， ^n) is the Vandermonde matrix 

1 fi _1 fi~ 2 ... fi _(n_1) ' 

〜)=1 f 2 - 1 f 2 _ 2 … f 2 _ (n -D 

暑* • ••參 » 

1 “- 1 fn_ 2 …“- 卜 1 )- 

in which the fi 一 1 are distinct (cf. Exercise 1, p. 24). This proves the similarity 
and shows in fact that ⑹ = _1 where (fi) is the above matrix. 


__LINEAR TRANSFORMATIONS_ 43 

Two matrices in A n that are related in this way are said to be 
similar. As in the case of equivalence it is clear that two ma¬ 
trices in A n are similar if and only if both are matrices of the same 
linear transformation relative to (single) bases for 9? over A. 

As we shall see in the next section, it is easy to give necessary 
and sufficient conditions for equivalence of matrices. On the 
other hand，the problem of similarity requires a fairly elaborate 
analysis, which we shall undertake in the next chapter. At this 
point we illustrate the method that we shall use to handle this 
problem. 

Example. We wish to prove that the matrices 
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EXERCISES 


1. Prove that the relations of equivalence and of similarity are reflexive, sym¬ 
metric and transitive. 


2. Prove that, if A has characteristic 0, then the following two matrices are 
similar in A n 


(a)= 


-1 

1 

• • • 1 ’ 


'n 

0 

… O' 

1 

1 

• • • 1 

， iff ) = 

0 

0 

• • • 0 

• 

• 

參 》 參 鲁 

參 

• 

• • • • 

.1 

1 

… 1- 


.0 

0 

• • • 0- 


6. Rank space and null space of a linear transformation. If 

^ is a linear transformation of into 況 2 , and ©i is a subspace of 
3?!, then the image consisting of all vectors of the form 
Xi in is a subspace of If yi e @ l5 then + jVi e @ l5 
and so x^A + y x A = {xi + y\)A e Also, if e axi e 

©i ； hence aix^A) = {axijA e If the vectors • • .，/ w 

are generators for any e @i has the form Hence any 

x x A = 2^-(/^). Thus the image vectors /i^/ 2 ^ - - 、 j m A are 
generators for If the/* form a basis for ©i, m = dim ©x. 

The images JiA need not form a basis for but since they are ， 
in any case, generators, their number m > dim Hence we 

see that the dimensionality of the image space never exceeds 
that of the original space. 

We shall call the subspace of 況 2 the rank space of A\ its 
dimensionality the rank of A. If {e u e 2y • • . ， e n ^) is a basis for 
= [ei^ y . • •， e ni yf\ y the space spanned by the vec¬ 
tors eiA. Hence the rank of A is the rank of the set e 2 A 、 

• • • ， e ni A). If (/i ， / 2 , • • •，/ n2 ) is a basis for 9? 2 and dA = X) 叫 i/y ， 

3 

i = 1 ， 2 ，…， n u then the rank of the set (e^4, e 2 A y …， e ni A) is 
the same as the row rank of the matrix (a) of A determined by 
the bases {e u e 2y • . • ， e ni ), (/ ly f 2y - - .，/ W2 ). This proves the fol¬ 
lowing 

Theorem 3. The rank of a linear transformation A of a vector 
space equals the row rank of any matrix of A. 

We consider next the totality 況 of vectors z in SRi such that 
zA = 0. It is readily verified that 沢 is a subspace of We 
call it the null space of A and its dimensionality the nullity of A. 
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We prove now the main theorem relating the rank and the nul¬ 
lity of A. 

Theorem 4. Rank of A nullity oj A = n u the dimensionality 
of the space dti. 

Proof. Let (z l3 z 2y . • • ， z y ) be a basis for 沢 . We can supple¬ 
ment this basis by — v vectors Xi to obtain the basis …， 
x ni _ v \ z u 2 ； 2 , •••，〜) for 5Ri. The vectors 

are generators for the rank space C 況 2 . Since the ZiA = 0, 
the vectors • • • ， x ni _ v A are also generators for 9?〆. But 

these vectors are linearly independent. Thus if 

+ + • • • + = 0 , 

then = 0 and e 91 = [zi, z 2y • • •, z„]. Since the 

set (^i, … ， x n 广 y ， z ly ••• ， z v ) is an independent set，this implies 
that the 氏 are all 0. Hence if we set yi = XiA y ( 力， y 2y • • 
y ni - v ) is a basis for Thus dim ^{\A = — v = — nul¬ 

lity of A and this proves the theorem. 

We now supplement the basis (y u y 2i … ， y ni - v ) of ^St\A to a 
basis Oh y 2 , • • • ， y nx - v , 您 1 ，您 2 ， • • • ， w n2 _ ni+v ) for 9f 2 . Then we 
have the relations 

= y iy i = …， p e ni — v 

2〆= 0， y = 1 ，…， r 

These show that the matrix of A relative to the bases (^i , …， 

^py . • •， ^v)y 1 ， • . • ， Jp ， 切 1 ， • • •， ^rt2 —p) ^ 

(18) diag{l7^7l ， 0, •••，（)}•* 

If the matrices of these bases relative to the original bases (e\, 
e 2 y •••，〜）and (/ u f 2y … ， f n ) are respectively (m) and 0 )， 
then, as we have seen in the preceding section, {ii){a){v)~ l is the 
matrix (18). The number p is the row rank of the matrix (a). 
This proves the following 

* We use this notation, introduced in (14), for a matrix whose non-zero entries occur 
only in the (1,1), (2,2), etc., positions. 
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Theorem 5 . If (a) is an X n 2 matrix with elements in a 
division ring A and if (a) has row rank p, then (a) is equivalent to 
the matrix given in equation ( 18 ). 

If (a) and (a) are equivalent matrices, then we know that these 
can be taken to be matrices of the same linear transformation A. 
The row ranks of (a) and of ⑹ coincide with the rank of A. 
Hence equivalent matrices have the same row rank. Conversely 
if (a) and ⑹ have the same row rank p ， then both of these ma¬ 
trices are equivalent to the same matrix ( 18 ). Hence they are 
equivalent. 

Theorem 6. Two n x X matrices with elements in a division 
ring A are equivalent if and only if they have the same row rank. 

We consider now the conditions that a linear transformation A 
of into 9 J 2 be an equivalence. Since ^ is a homomorphism ， 
A is 1-1 if and only if its kernel = 0. Clearly 9^ is the null- 
space of A. Hence is a 1-1 transformation of dii onto 沉 2 if 
and only if: ( 1 ) 況 = 0; (2) In the special case in 

which 9ii = 9?2 — 9? either of these conditions is sufficient; for if 
況 = 0 ， rank A = dim dl = n. Hence = 9J. On the other 
hand，if 3M = 9?， rank A = n and nullity A = 0 . Hence 9^ = 0 . 

It should be noted here ， too, that, if A is an equivalence, then 
its inverse A~ x is also an equivalence. The verification is left 
to the reader. The equivalences of a vector space onto itself 
constitute a group relative to the resultant operation. If is a 
linear transformation in 9? and (a) is its matrix relative to the 
basis (eiy e 2 , … ， e n \ then A is an equivalence in 9? if and only 
if (a) is a unit. Hence we see that the group of equivalences in 
5R is isomorphic to the group L(A y n) of non-singular matrices in 
A n . The former group is called the full linear group in the vector 
space 9?. 

EXERCISES 

1. Prove that, \i A ^ ?( 況 1 ， 9?2) and ©i and Ui are subspaces of 9?i, then 

(@i + Vii)j = © 1 ^/ + IW and n Ui)yf C ©J fl Ui^f. 

2. Prove that, if (a) and (j3) are m X n matrices with elements in A, then (row) 
rank [(a) + (/?)] < rank (a) + rank (jS). 

3. Prove that, if (a) is a,n m X n matrix and (0) is sm n X p matrix with ele¬ 
ments in A, then rank (a)03) < min (rank (a:), rank ⑹) • 


4. If 
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(«)= 



一 2 3' 
0 1. 


find units (jjl) and (v) such that (jj)(ol)(v) has the form (18). 

5. (Fitting). If is a linear transformation in 9?, let 3 be the set of vectors z 
such that zA m = 0 for some m and let © be the intersection of all the rank spaces 

k = 1 ， 2， • • •• Show that 3 and © are subspaces and prove that 5R = 
cB ㊉©. 

6. Show that A maps the two spaces 3 and © of Ex. 5 into themselves; that 
A is nilpotent in 3 and an equivalence in Use this result to prove that any 
matrix in A n is similar to a matrix of the form 

「⑹ o i 

- o (t). 

where ⑹ is nilpotent and where ( 7 ) is non-singular. 


7. Systems of linear equations. We consider the left-handed 
system of linear equations 


(19) 


Jl«ll + $2«21 + • • • + Jn«ni = ^1 
? 1«12 + ^ 2«22 + • • • + ? n « n 2 = ^2 


芒 l^lm + 专 + • • • + ^n^nrn ~ 

Here the a" and Si are given elements of the division ring A, and 
we seek solutions ^ ^ in A. If ^ satisfies these equa¬ 

tions, then we say that the w - tuple (/3 ly /3 2 , . • • ， P n ) is a solution. 
If (/3i, /3 2 , • • •, jS n ) and ( 卢 / ， /V，…， jSnO are two solutions of 
(19)，then ( 71 , y 2 y • • • ， 7 n) where ji = — ^ is a solution of 

the system of homogeneous equations obtained by taking the 
8i = 0 in (19). Conversely if (fi ly j 8 2 , • • •, ]S n ) is a solution of (19) 
and ( 71 , y 2 y • • • ， 7 n) is a solution of the homogeneous system, 
then OV ， /V， • • • ） Pn) where /?/ = + ji is another solution of 

(19). This shows that in order to obtain the solutions，if any, of 
(19) we have to find a particular solution of this system and all 
solutions of the corresponding homogeneous system. We will 
then obtain all solutions of (19) by adding to the particular solu¬ 
tion all solutions of the homogeneous system. 

We therefore consider first the question of the existence of 
solutions for (19). We introduce the vectors i = 1, 
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2 ， • • • y n y v = 25 y/y where (/i ， /2，• • . ， /w) is a basis for the m 
dimensional space ©. Then it is immediate that (/ 3 U 尽 2, • • • ， ^n) 
is a solution of ( 19 ) if and only if the satisfy 

( 20 ) V = PiUi + ^ 2^2 + • • • + 

Hence (20) is solvable if and only if v is linearly dependent on 
u 2y •… ， u n . On the other hand, v is linearly dependent on 
the Ui if and only if 

rank " 2 ， • • •， u n ) = rank u 2y • • •， u n ， v) } 

and this in turn holds if and only if the row rank of the matrix 
(a) is the same as that of the augmented matrix 

<^11 <^12 • • • Oi\m 

a 21 «22 • • • Oi2m 

( 21 ) . 

^n2 * a nm 

^2 ... - 

In particular, if A = <l> is commutative, then we have the fol¬ 
lowing 

Theorem 7 . A system of linear equations ( 19 ) with aij and dj 
in a field 电 has a solution ^ in $ if and only if the matrix (a) 
of the coefficients and the augmented matrix (21) have the same de- 
terminantal ranks• 

We consider next the homogeneous system obtained by setting 
5 j = 0. To study this system we introduce also an n dimensional 
vector space 9? with the basis ( 〜 e 2y … ， e n ) y and we let A be 
the linear transformation whose matrix is (a) relative to the bases 
(eiy e 2y •••， e n ) y ( 九 /2， • • •，/ 饥 ). Then in the above notation the 
vectors Ui — eiA and (/?i ， p 2y • • • ， &n) constitute a solution of the 
homogeneous system if and only if 2 / 3 ^^ = 0 . Since Ui = eiA y 
this amounts to the condition = 0. Thus d / 3 2 , • • •， 

fi n ) is a solution if and only if is in the null space 況 of A. 
If v is the nullity of A 、we have a basis (zi, z 2y •••，〜) for 价 and, 
if Zk = 々 = 1 ，2 ， • • •, v y then 

⑹⑴， 32 ⑴心⑴） ，…， ( Pl ( V \ 心，…， /3 n °°) 
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is a set of (left) linearly independent solutions of the homogeneous 
system. Moreover, any solution d / 3 2 ，• • / 3 n ) is a linear com¬ 

bination of these solutions. Because of the relation between 
rank and nullity, we know that v = n — p where p is the row 
rank of the matrix (a). We therefore have the following result: 

n 

Theorem 8. Let ^ = 0 , ）= 1 ， 2 , …， & a left-handed 

i = 1 

system of homogeneous equations and let the row rank of {a) be p. 
Then there exist n — p linearly independent solutions 卢 2 ⑻， 

• • •， ⑻)， k = 1 ，2， • . ., n — p y such that any solution of the sys¬ 
tem is a left linear combination of these solutions. 

An immediate consequence of this theorem is the result，noted 
previously in an exercise (p. 13 )，that a system of m homo¬ 
geneous equations in more than m unknowns has a non-trivial 
solution. We remark also that in the commutative case we can 
drop the modifier “left” in the above statement and replace rank 
by determinantal rank. 

EXERCISE 

Find all the solutions of the following system 

2?i - - 3^4 = 0 

- ?3 -f- 2^4 = 0 

Hi + ?2 - = 0 , 

△, the field of rational numbers. 

8. Linear transformations in right vector spaces. If St/ and 

況 2’ are right vector spaces, a linear transformation of 9?i / into 
況 2’ is defined to be a mapping of 9?i 7 into ^2 such that 

( 22 ) {x f + y f ^A = x r A + y’ A 、 {x f oi)A = {x f A) ol 

for all y r in and all a in A. The discussion for left vector 
spaces can be carried over to the present situation with one or 
two notational changes. If (e/ y e 2 \ • . • ， e ni ’) and (/i’ ， /2’，• • 
/ n /) are bases in 9?/ and respectively, we write 

712 

( 23 ) e/A = i = 1 ， 2 ,…， 
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and we call 

'«n 

«12 

… «ln 2 ' 

(24) 

«21 

• 

«22 

• 

… «2n 2 

• • • • 


-^nil 

^ni2 

* ^nin2 - 


the matrix of the linear transformation A relative to the given bases. 
It should be noted that ( 24 ) is the transposed of the matrix of 
the coefficients on the right-hand side of ( 23 ). As before, to the 
sum of linear transformations corresponds the sum of matrices. 
The situation for the product is ， however, different from that of left 
vector spaces. Suppose that {gi y g 2 ; y ••• ， g nz f ) is a basis for 況 3 ’ 
and let 5 be a linear transformation of $R 2 / into Let ⑻ be 

the matrix of B relative to the bases (/i’ ， /2’，• • . ， /n 2 ’) ， C?i’ ， 兄 2 ’， 
•••，“’)• Then 

f/B = j = 1 ，2， … ， ”2. 

Hence 

e/AB = = X (f/B)% = X) gk^kjotji 

\ i / j j,k 

=^gkjki 

where jki = Thus the matrix of C = AB is the prod- 

3 

uct (j8) (a) and not (a) ( 13 ) as before. 

If 況 ’） denotes the ring of linear transformations of 

dt f into itself，then the correspondence A (a) between the 
linear transformations and their matrices relative to a definite 
basis « e 2 \ •••， e n f ) is now an anti-automorphism. Thus it is 
1-1，and to the sum of linear transformations corresponds the 
sum of the matrices, and to the product of linear transformations 
corresponds the product of the corresponding matrices taken in 
reverse order. The ring is anti-isomorphic to the matrix ring 
△ n and hence also to the ring 2 of linear transformations in an 
衫 -dimensional left vector space over A. 

A change of basis from « e 2 ’， • • •， e n /) to (u/ y m 2 ’， …， "m’） 
where u/ = 'Le/fiji and a change of basis from (/i’，/2’，•. .，九’） 
to {vij v 2 \ …， y n /) where v p f = 2 f q f v qp is now reflected in a 
change of the matrix of A from (a) to 

⑹ =W _ 1 W(M). 
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If a single basis is used in = SR 2 / = 況’， the matrix (a) of A 
is replaced on changing the basis by the similar one (/x) "~ 1 (a) (m) 
where (ju) gives the change of basis. 

Our discussion of rank and nullity may be carried over with¬ 
out change. The rank of A now turns out to be the column rank 
of its matrices. This implies that equivalent matrices have the 
same column rank as well as the same row rank. Now we have 
seen that any matrix (a) is equivalent to one in the ‘‘normal’’ 
form ( 18 ). Also it is immediate from the definition that a matrix 
in normal form has the same row rank and column rank. It fol¬ 
lows that the arbitrary matrix (a) has the same row rank and 
column rank. We state this result as 

Theorem 9. The row rank and the column rank of any matrix 
are the same. 

A second, and somewhat more geometric，proof of this result 
will be given in § 12. We note finally that the theory of right- 
handed systems of linear equations can be developed in a man¬ 
ner completely analogous to that of left-handed systems con¬ 
sidered above. We have only to replace left vector spaces by 
right vector spaces. 

EXERCISE 

1. State and prove the analogue of Theorem 7 for right-handed systems. 

9. Linear functions. We have defined a linear function on a 
vector space 況 to be a mapping x f{x) of into A such that 

/o + y) =f(x) +f(y)y /(ax) = a/(x ). 

If we define the sum of two such mappings in the usual way by 

(/ + g) M + gM 

and the product j\x for /x in A by 

(/m)0) =/0)m ， 

then we obtain a right vector space 5R* over A. This can be 
verified directly. However, it may be more illuminating to in¬ 
tegrate this result into the general theory of linear transformations 
developed in § 2. 
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For this purpose we recall that a linear function is just a linear 
transformation of dt into the one-dimensional vector space A. 
Now the right multiplication fi r : ^ ^ is a linear transforma¬ 

tion in the vector space A, since 

(? + n)Mr = (? + rDfi = ^ + rjfx = ^\x r + rjfx r 

(aQ/Xr = = a ⑸ = a(fMr). 

Also we know that the set of linear transformations of dt into A 
is a commutative group under addition and that the resultant of 
a linear transformation of 9 ? into A and a linear transformation 
of A into itself is a linear transformation of 9? into A. Hence if 
/ and g e 2 ( 9 ?， △)，then f + g and ffx r e S(9f ， △)• Since the defini¬ 
tion oifix given above is simply the resultant //x r ， 

(/ + s)^ = (/ + 畧 ) Mr = /Mr + gfJ^r = 

/(M，+ 0 =/(M + = /(Mr + Vt) =/^r + M = ffX + fp 

=/OOr =/(Mr 〜） =(/Mr)^r = (» 

/I = f^r = /• 

This establishes the assertion made above that the set 況 * of 
linear functions is a right vector space over A. We call this 
space the conjugate space of the vector space di- 

Now suppose 5R is finite dimensional with the basis (e 1} e 2y 
• • •, e n ). A linear function / is completely determined by the 
values f(ei) = ai ， Moreover, for arbitrary ai e A there exists a 
linear function such that f{e v ) = ai ， If x = 2^ 穴 ， then f(x)= 
We can also state these simple results in terms of matrices 
as follows. If/ is a linear function and / ⑹ = a iy then we can 
use the basis 1 in A and write / ⑹ = a^. Then we see that the 
matrix of / relative to {e u e 2y … ， e n \ (1) is 
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We obtain in this way a 1-1 correspondence between 9?* and the 
set of w X 1 matrices with elements in A. Sums correspond 
under this correspondence. Also it is immediate that, if / has 
the matrix ( 25 )，then j[x has the matrix 

'oliix 


From this it is clear that 沉 * is equivalent to the right vector 
space of 衫 -tuples (now written as columns). Evidently this im¬ 
plies that 9 J* is n dimensional over A. 

The last result can be made somewhat more transparent in 
the following way. If (ei y e 2y • • • ， e n ) is a basis for 9? over A, we 
define a set e 2 * y • • e n *) of linear functions by the equations 

( 26 ) e^{e 3 ) = S ijy i y j = 1 ， 2 ,…， n, 

where 5{j = 0 if / 〆 j and = 1 if / = j. Then the value of the 
linear function for ej is 

2 = OLjy j = \ y 2 y n 

% i 

and this implies that the form a basis for 9?* over A. Thus if 
/is any linear function and f(ej) = then / and have the 

same values at the ej. Hence / = Also the are lin¬ 
early independent; for if = 0， then the displayed equa¬ 

tions show that every aj = 0. We shall call the basis (q* ， e 2 * y 
• • • ， ^n*) the complementary basis to (e ly e 2y • • • ， e n ). Such bases 
will play an important role in the sequel. 

EXERCISE 

1. Prove that the right multiplications are the only linear transformations in 
the vector space A. 

10. Duality between a finite dimensional space and its con¬ 
jugate space. Let a: be a fixed vector in the space 況 and let / 
range over the conjugate space 9?* of 9?. Then the mapping 
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f — f{x) appears to be a mapping of 5R* into A. To emphasize 
that we are now dealing with a function of / e we write x{f) 
iorf{x). We assert that x{f) is linear; for 

^( / + g) = (/ + 《 )0) = /0) + 《 0) = ^(/) + 

%(/«) = (Jol) (at) =f(x)a = x{f)a. 

Thus we see that every vector x edt determines an element x(f) 
of the (left) vector space 9?** of linear functions defined on 9?*. 

We consider next the properties of the mapping x —> x(f) of 
yt into SR**. We note first that this mapping is a linear transfor¬ 
mation of 5R into 況 **; for 

0 + J)C0 =/(x +y) =/(x) +f(y) = x(f) +y(f) 

and this means that the function associated with x y is the 
sum of the function x(f) and jy(/). Also 

(ax) (/) = f{ax) = af{x) = ax(f) y 

so that the linear function associated with ax is a times the linear 
function associated with x. We prove next that x —> x(f) is 
1-1. For this it suffices to show that，if x(f) = 0 for all /， then 
^ = 0 . Now this is clear; for if* % 〆 0 , we can take x as the first 
vector ei of a basis {e u e 2y …， e n ). We have seen that there 
exists a linear function / such that J{e> = oti for any given 
In particular，we can find an / such that f{x) = /(^i) 0 . 

We have now established that the mapping x —> x{f) is a 1-1 
linear transformation of 9? into 9?**. Hence if © denotes the 
image space，dim @ = dim dt = n. On the other hand, we know 
that dim 況 =dim = dim 9?**. Hence dim © = dim 況 **. 
This，of course，implies that © = 9?**. We are now led to the 
striking conclusion that every linear function on 9?* can be ob¬ 
tained as an x(f) for some vector ^ e This is the important 
principle of duality that dt can be identified with the conjugate 
space of (the space of linear functions on) 3i*. As a first applica¬ 
tion of this result we prove the following 

Theorem 10. If (ei* y e 2 * y • • e n ^) is a basis for 9?*, then there 
exists a basis (ei y •••，〜）for dt such that e^iej) = 3 ". 
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Proof. We know that we can find in 5R** a basis (o** ， ^2**, 
.•• ， ^n**) that is complementary to the given basis (^1*, e 2 * y 

• • • ， fn*)，that is，^**(^*) = 8 ij. But there exist vectors e u e 2y 

• • - 5 e n in dt such that e^iei) — G **(~*)，/•，j = 1, 2, •••，”• 
These vectors satisfy the conditions of the theorem. 

We shall establish next a reciprocal relationship between the 
subspaces of 9 ? and the subspaces of its conjugate space dt*. If 
@ is a subspace of 9 ?， we let 7(©) be the totality of vectors ^ 80 ?* 
such thatgCy) = 0 for ally e The set)(@) is clearly a subspace 
of 9 ?*，and we shall call it the sub space of ^ incident with ©. 
Similarly if ©* is a subspace of SR*，we obtain the subspace 7(©*) 
incident with ©*• This consists of the vectors y such that g(y) 
= 0 for all g 8 Evidently if ©1 3 @ 2 , then 7 *(@ i ) C y (® 2 )， 
that is, the correspondence @ ^ 彡 (©) is an order reversing cor¬ 

respondence of the lattice L( 9 i) of subspaces of 9 ? into the lattice 
L( 9 i*) of subspaces of 9 ?*. It is clear also that 7(7(©)) 3 ©. 
We prove next the following 

Lemma. For any @ C dim j(@) = w 一 dim @ and for any 
©* C 況 *， dim i(©*) = n — dim ©*. 

Proof. Because of the duality between 9? and 況 *， it suffices to 
prove one of these statements. We choose the first. Let © be a 
subspace of dt and let {u u u 2 , •… ， u n ) be a basis for dt such that 
("1 ， "2，• • • ， "r) is a basis for ©• Let (ui* y u 2 * y • • • ， u n ^) be the 
complementary basis for 況 *. Suppose now that^* = 2 d 
Then (2 〜 U (〜 ） = 0 forj = 1 ， 2 ， •••，”• But ( 2 d)(Uj)= 心 

n n 

Hence g = ^2 Conversely，any linear form g = 

r + 1 r + 1 

satisfies g(uj) = 0 forj = 1 ， 2 ， • • •， r. Hence also g(y) = 0 for 
every jy e Thus 7(©)=[ 〜 +i* ， "r+2* ， ••• ， u n ^\. Hence 
dim © = r while dimy(©) = n — r. 

An immediate consequence of this lemma is thaty(j(©)) = © 
andjOX©*)) = ©* for any @ and Thus we have seen that 
i 0 *(©)) 3 Moreover, dimjXiC©)) — n — {n — r)\i dim @ = 
r. Hence dim 7(7(©)) = dim @，and this implies that © = 

We now see that the mapping © —> )(©) is a 1-1 mapping of 
L ( 況） onto If i(©i) =)(©2 )， then @1 = iO*(©i))= 
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«/C/(®2)) = ©2. Moreover, if @* is any element of then 

©* = 7(©) where © = 

EXERCISES 

1. Prove that, if @ — © is a 1-1 order reversing correspondence of one lattice 

onto a second one, then ©i + ©2 = @1 门 ©2 and ©1 门 ©2 = ©i + © 2 . 

2. Let/ be a linear function on 0? and let f denote its contraction on the sub¬ 
space © of 9?, that is, / is the mapping y —> f(j) for y in ©. Show that the 
mapping/ — / is a linear transformation of into the space of linear func¬ 
tions on ©. Show that ^(@) is the null-space of this transformation. Prove 
that / —» / is a mapping of 9?* onto ©*. 

3. Prove that, if ei* y ^ 2 *, … ， ^r* are linearly independent linear functions 
then there exist vectors ^ 2 , ... ， G such that ^*(^) == 1 ， 2, •••，”• 

11. Transpose of a linear transformation. Let be a linear 
transformation of into 9? 2 and let / be a linear function de¬ 
fined on 況 2. Then the mapping f{xiA) is a linear function 

defined on 況 1; for this mapping is simply the resultant Af of 
A and/, that is, 

( 27 ) ⑷⑹ =f(x 1 J). 

We now let / vary over the conjugate space SR 2 * of 沉 2 . Then we 
obtain a mapping/ Aj of 9 i 2 * into 9?i*. We assert that it is 
linear. By the distributive law 

+ g) = 4 /*+ 々 

and by the associative law 

^(/m) = /(/Mr) = 

and these are the defining conditions. We shall call the linear 
transformation/ — Aj of 9 J 2 * into 9 ?i* the transpose of A and we 
denote it as Hence fA^ = Af where on the right Aj is the 
resultant of A and/. 

We consider next the properties of the mapping A 
First, if 5 is a second member of 8 ( 9 ^ ， 9 ? 2 )> then A -\r B z S (況 1 ，沉 2 )， 

f{A + Br =(J + B)f = Jf+ +/ 5 * =/(/* + B”. 

Hence 

( 28 ) (J + B)* = yf* + B*. 
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Now let 9? 3 be a third vector space and let C be a linear transfor¬ 
mation of 3 i 2 into 況 3 . Then AC z 2 ( 9 ?i ，9 ?3). Hence if A e 9?3 *， 
h{ACy^ = {AC)h e 9?i*. Moreover, 

h{ACY = 、 AC、h = A{Ch) = ^(AC*) = 
and this proves the rule 

( 29 ) (yfC)* = C*^*. 

Our results also apply, of course, to right vector spaces. In 
particular, if is a linear transformation of the right vector 
space of linear functions 沉 2 * into the right vector space 況 i *， 
then we can associate with it a transpose transformation of 5Ki** 
into 況 2**， where 礼 ** is the left vector space of linear functions 
on 況 i*. On the other hand, we have the natural equivalences of 
9?^** onto 9^ and these enable us to define a linear transformation 
of 9?i into 9? 2 corresponding to the transpose of We shall call 
this transformation the transpose of in to 9 t 2 . We 
now determine the transformation /** for the given linear trans¬ 
formation of $R 2 * into Let / vary over 況 2 * and let x x 

be a definite vector in 9^. Then the mapping 

f — = (/^*)(a ； i) 8 A 

is a linear function on 9 t 2 *. Hence there is a uniquely determined 
vector x 2 e 9?2 such that 

( 30 ) = aC/) ^ 2) 

holds for all /e We now have a mapping /** sending 

into x 2 - The argument given above shows that this mapping is 
linear. This can also be verified directly. 

We shall now show that the two correspondences A —> 
and are inverses of each other, that is, if is the 

transpose oi A z S(9ii ， 況 2 )，then the transpose of yf* in to 沉 2 is 

A and，if is the transpose in 況 1 to 況 2 of e 2 ( 況 2 *， 況 1*)，then 

the transpose of is A^. To see the first of these statements 
we note that = f{x x A^) by the definition of /**• 

Hence f{xiA) = /( 々 yf**) and f{xiA — x^A^) = 0 holds for all 
/• As we have seen (p. 54 ) this implies that X\A = for 
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all Xi so that A — yf**. The second statement is proved by 
using the relation 

=/(>〆**) = (//***) (A). 

Since this holds for all = /yf*** and = /***• It is 

now immediate that the mapping A is 1-1 of 8(9?i ， $K 2 ) 

onto S ( 況 2 * ， SRi*). 

In the particular case of S = S ( 況，況 ） and S* = 9?*) the 

mapping A —> is an anti-isomorphism between these two 

rings. This is clear from the 1 - 1 -ness and equations ( 28 ) and 

(29). I I 

12. Matrices of the transpose. Again let be a linear transfor¬ 
mation of $Ri into 況 2 and let (e u e 2y • • •， e ni ) y (/i,/ 2 , •- .，/ n2 ) be 
bases in these spaces. We choose complementary bases (q* ， e 2 ^ y 
• • • ，〜 *) ，（ /i* ， /2*，• • • ，入 2 *) in the spaces 況 2 *. Hence 

e^{e 3 ) = d ih / P *(A) = 8 pq . 


Suppose now that (a) and ⑹， respectively^ are the matrices of 
A and of its transpose relative to these bases. Then 


eiA = X a ipfpy /g*/* = 


V 


Since//O〆）=/ 3 *^*(^), 


A* (l2 = X) OZ/WOi). 


Hence 


= Pi q and (a) = (/ 3 ). In other words ， if complementary 
bases are used in 9 ^， and in 3?^*, i = 1 ， 2 , then the matrices of A 
and of its transpose are equal. 

This result is perhaps a little unexpected. Its explanation lies 
in our definitions of matrices of linear transformations in left 


vector spaces and in right vector spaces. In the special case in 
which △= 中 is a field the result usually appears in a somewhat 
different form. Here it is customary to consider all spaces as 
left vector spaces，as can be done by writing ax for xa. Then 
the relations e^aj q that we have just derived may 

be written as j 


= I ： q 


氺 


a 


JQ 


z 


ajq€j 


氺 




qj 


氺 
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where a q / = aj q . Thus the matrix of A 冬 considering the as 
left vector spaces is the transposed matrix (a)’ of the matrix (a) 
of A. If 9 ?i = 9?2 = 9 ? we have the isomorphisms A —> (a) and 
{a) f of the rings of linear transformations 2 = 9?) and 

S(9?* ，9 ?*) respectively onto the matrix ring $ n . Since A A 丸 

is an anti-isomorphism we see that the mapping (a) —> {a) f is an 
anti-isomorphism in ^ ny that is ， (a) —> (a)’ is 1-1 and 

[w + ⑹ r = (# + ⑻，， [(■]，= may. 

This，of course, can also be verified directly. 

We return now to the general case of an arbitrary division ring, 
and we shall establish the following relation between rank spaces 
and null spaces of a linear transformation and its transpose. 

Theorem 11. The null space of A is the subspace incident with 
the rank space of the transpose A* of A. The rank space of A is the 
subspace incident with the null space of A*. 

Proof. It is sufficient to prove the first of these statements. 
Hence let z be a vector such that zA = 0 . Then f(zA) = 0 and 
{fA^){z) = 0 for all /. Hence z The converse fol¬ 

lows by retracing the steps. 

We can now prove 

Theorem 12. Rank A = Rank 

Proof. Rank = dim ( 況 2 */*) = dimj(^) where 91 is the null 
space of A. Also dim y ( 沢 ) =ni — dim 況 where ri\ = dim 9 ?i = 
dim On the other hand, rank A — ri\ — dim 5R. Hence 

rank A — rank A*. 

If (a) is any matrix ， (a) can serve as the matrix of a linear 
transformation A and also of the transpose of A. Then, as we 
have seen, rank A is the row rank of (a) while rank is the 
column rank of (a). Theorem 12 therefore gives a geometric 
proof of the theorem that the two ranks of any matrix are equal. 

13. Projections. We conclude this chapter by considering a 
type of linear transformation of a vector space that is intimately 
connected with direct decompositions of the space into subspaces. 
Suppose that 9 ?= 況 i ㊉ 況 2 ㊉ • • • ㊉ 況 r，that is , 況 is a direct sum 
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of the subspaces dti in the sense of § 11， Chapter 1 . Then if x is 
any vector in dt y x may be written as 


(31) 


X = + • . . + 


where Xi e dti. We know also that for a given i the component Xi 
of x in 9?^ is unique. Hence the mapping Ei that sends x into Xi 
is single-valued. We wish to investigate the properties of these 
mappings. Let y = ji + jy2 + * * * + jyr, e then 

x + y = (xi + yi) + + JV2) + … + (x r + y r ) 

where Xi + ji e 礼 •• Thus the component in of ^ + jy is Xi + 
Hence we have the following condition on Ei ： 

(x + y)Ei = xEi + yEi ， 


Also by ( 31 ) 


ax = aX\ + aX2 + • • • + olx t . 


Hence the component in dti of ax is ax it In other words，we have 
the relation 

{ax)Ei = a{xEi), 

We therefore see that Ei is a linear transformation in 沉 over A. 

We consider next the relations that hold among the We 
note first that ( 31 ) may be rewritten as 

( 32 ) x = xE\ +... + xE r . 

Hence 

( 33 ) Ei E 2 - E r = 1 . 

If Xi e dliy the representation ( 31 ) of ^ = Xi reads Xi = X{. Thus 
X{Ei = x iy XiEj = 0 if j 9 ^ i. Now for any xEi = Xi e 
Hence we see that xEi 2 = X{Ei = Xi = xEi and xEiEj — XiEj — 
0. We therefore have the following equations. 

( 34 ) = Eiy EiEj = 0 if i 9 ^ j- 

Now，in general，we shall call a linear transformation E that 
is idempotent in the sense that it is equal to its square (£ 2 = E) 
a projection. A set of projections will be called orthogonal if the 
product of any two distinct ones in the set is 0. Finally we shall 
say that the set of orthogonal projections E 2y • • •， £ r is sup¬ 
plementary if their sum is the identity mapping. Then the re- 
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suits that we have just obtained concerning the mappings Ei de¬ 
termined by the decomposition 9 ? = 9?i ® 9 f 2 ® • • • ® 9? r are that 
these mappings form a supplementary set of orthogonal projec¬ 
tions. We shall now show that every finite supplementary set of 
orthogonal projections is obtained in this way. Thus let E u E 2y 
• • • ， be such a set. Let dti = dtE“ the rank space of 
Then if x is any vector in 3J 

x = x\ = x(XEi) = xEi + xE 2 + • • • + xE r 

e -f- 9? 五 2 + • • • + 

Hence 況 = 況 i + 況 2 + • • • + 9 ?r. Next let 


A = 2^ 十 • ••十 十 Zi^i +•••+、 

where Zj e Since Zi has the form yiE iy ZiEi = yiE { 2 = 

Similarly if j i y ZjEi = yjEjEi = 0. Hence if we operate 
on the left-hand side of (35) with we obtain z { and，if we oper¬ 
ate on the right-hand side, we obtain 0 . Hence Zi = 0 . This 
proves that 礼 . fi (9?i + • •. + 礼 ._i + +.. • + 9? r ) = 0 for 

i = 1 ， 2 ， • • •， r. Thus dt = 況 i ㊉ 況 2 ㊉ …㊉ 況 r. Since x = XxEi 


and xE{ = Xi e 9^-，the projections determined by this decomposi¬ 
tion are the mappings x xE iy that is，the given linear transfor¬ 
mations We have therefore established a 1—1 correspondence 
between direct decomposition of the vector space and finite sets 
of supplementary orthogonal projections. 

We obtain next canonical bases for the set of supplementary 
orthogonal projections E ly E 2y …， E T . Let 9? = 9fi ㊉. ••㊉ 9? r 
as above. Then we can obtain a basis (/i ， /2 ， • . . ， /n) for 9? such 
that (/i，• . .，/ pl ) is a basis for 9^， （/ P1+1 ，• . •，/ P1 + P2 ) is a basis for 
況 2, etc. Thus pi = rank Since EjEi = 0 forj/i ，the linear 
transformation E{ annihilates all the /’s outside the i-th subset 

Since Ei 2 = E iy any vector in dti 
=dtEi is sent into itself by It follows that the matrix of 
Ei relative to the basis (/i ， /2，• • •，/ n ) is the diagonal matrix 

( 36 ) (S^ = diag { 0 , • • • ， 0 , 1 ， • • . ， 1 ， 0 ,… ， 0 } 


in which all elements are 0 except those in + • • • + Pi-i + 1 st 
to pi + ••• + pith rows. 
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We now drop the assumption that = 1. Thus we suppose 
that Ei y E 2y • • • ， E r is any finite set of orthogonal projections. 
Set E = 'EEi and E r+ i = 1 — Since = 0 for i ^ j, <r, 

E 2 = = XEi = E. Hence also E r+ i 2 = (1 — E ) 2 = 1 — 

2 E + E 2 = l — 2 E + £ = 1 _ £ = E r+1 . Moreover, if y < r ， 
EjE = Ej'ZEi = Ej 2 = Ej and similarly EEj = Ej. This implies 
EjEr+i = Ej{\ — E) = Ej — EjE = Ej — Ej = 0 and E r+ iEj 
= 0. We have therefore shown that the set E u E 2y • • •，£ r+ i is 
a supplementary orthogonal set of projections. Our discussion 
shows that there exists a basis (/i ， /2，• • . ， /n) of 況 such that the 
matrix of E{ relative to this basis has the form ( 36 )，i = l y 2 y 
• . r. 

These remarks apply in particular to a single idempotent lin¬ 
ear transformation. If E\ is of this type, then E\ and £2 = 1 
— Ei are orthogonal and supplementary. Relative to a suitable 
basis the matrix of Ei has the form diag {1 ， 1， . • • ， 1 ， 0， .••，（)}• 
The number of l’s is the rank of Ei ， 

EXERCISES 

1. Prove the following theorem on matrices: If (€ 1 )， ⑹， •. • ，（ e r ) is a set of 
matrices such that 

(37) (ei) 2 = (ei), (ei)(ey) = 0 if i 參 j, 

then there exists a matrix (jit) in L(A, n) such that (M)fe)(M)— 1 has the form (36). 

2. Prove that two projections E and F have the same rank spaces if and only 
if EF = E and FE = F. Prove that they have the same null spaces if and only 
if EF = F、FE = E. 

3. Show that, if E\, £ 2 ， • • •，^ & are projections with the same rank spaces and 
a h « 2 ,…，收 are elements of A such that = 1, then HaiEi is a projection 
with the same rank space as the E{. 

4. Assume that the characteristic of A is not 2. (This means that, if a 〆0, 
then 2a = o: + a 〆 0 in △•) Prove that, if E\ and E 2 are projections whose sum 
is a projection, then E\ and E 2 are orthogonal. 

5. Show that, if E\ and £2 are commutative projections, then E 1 E 2 and 
Ei + E 2 — E 1 E 2 are projections. 


Chapter III 


THE THEORY OF A SINGLE 
LINEAR TRANSFORMATION 


This chapter is devoted to the study of a single linear transfor¬ 
mation in a vector space over a field. We shall obtain a decompo¬ 
sition of the vector spaces into so-called cyclic subspaces relative 
to a given linear transformation. By choosing appropriate bases 
in these spaces we obtain certain canonical matrices for the trans¬ 
formation. These results yield necessary and sufficient condi¬ 
tions for similarity of matrices. Following Krull we shall derive 
the fundamental decomposition theorems by making use of the 
theory of finitely generated o-modules, o a principal ideal domain. 
We shall also prove in this chapter the Hamilton-Cayley-Fro- 
benius theorems on the characteristic and minimum polynomials 
of a matrix. Finally we study the algebra of linear transforma¬ 
tions that commute with a given transformation. 

1. The minimum polynomial of a linear transformation. 
Throughout this chapter we assume that the underlying division 
ring is a field. We use the notation 中 for this field. Let be a 
vector space over 伞 and let 8 = 9?) be the set of linear trans¬ 

formations of 5R into itself. We recall that 2 can be regarded as 
an algebra over ^>: that is, 1) 8 is a ring ； 2) 8 is a vector space 
over with addition the same as the ring addition ； and 3 ) 

y{AB) = {yA)B = A{yB>) 

holds for B in 2 and y in The product yA is by definition 
the resultant 1\A = All ， We recall also that 2 is n 2 dimensional 
over 屯 
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Now let A be an arbitrary linear transformation in and let 
[ 1 ， A 、 A 2 、 • • •] be the subspace of 2 spanned by the powers of A, 
A is not a multiple of 1 , the pair ( 1 ， A) is a linearly independent 
set. Again if A 2 is not linearly dependent on ( 1 ，then，since 
(1， A) is an independent set, so also is (1， A 、 A 2 ). Continuing 
in this way we obtain the linearly independent sets (1)，（1， A\ 

(1，W， W 3 ): … • 

Since 2 is finite dimensional，this process must break off after 
a finite number of steps. This, of course, occurs when we reach 
the first power A m of A which is linearly dependent on preceding 
powers. Then (1， A, A 2 y •••， A m ~ l ) is linearly independent， 
but A m e[\ y A y A 2 ^ • • 、 A m ~ x \. Hence we have a relation of the 
form 

( 1 ) A m = jU 0 l + + • • • + 

where the e<i>. Multiplication of (1) by A yields, in virtue of 
the distributive law and the algebra condition 3 ) above, the 
equation 

A m+l = jd 0 J + fJLiJ 2 + • • • + 

Since A m e [ 1 , A 2 ^ • • •， A m ~ x \ this shows that A m+l e [1 5 
yf 2 ，. • Similarly we can prove that A m +2 , • • • 

are in [1 5 A 2 ^ •. •， A m ~ x \ Hence 

[ 1 , A, A\ …] =[ 1 , A y A\ …，产一 1 

and since the displayed set of A k is a linearly independent one， 
we see that [1, A 2 ^ …] has the basis (1, yf 2 , • • •， 

The relation (1) has an important interpretation which we shall 
now examine. We note first that the mapping 

(2) a —^ al = 
is an isomorphism of $ into 2 . Thus 

(a + / 3)1 = al + /31 

⑶ 

(a/ 3 )l = (a^)(l 2 ) = a(^(l 2 )) = a:(l(/ 3 l)) = (al) (戸 1) 

and al ¥ 0 if a 〆 0 so that the mapping is 1 - 1 . It follows that 
the image set 中 1 is a subfield of 2 isomorphic to 
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Now let denote the integral domain of polynomials in the 
transcendental element (indeterminate) X with coefficients in 中 . 
The linear transformation A commutes with every element 
al(= a\). It follows from this that the mapping 

(4) /(X) = «o + oii\ + a 2 \ 2 +•••—> 

= 0^()1 + - f - + • • • 

is a homomorphism of 中 [X] into S. This homomorphism is an ex¬ 
tension of the isomorphism (2)，and it is characterized by the 
property that it maps 入 into A. Let 贷 be the kernel of our homo¬ 
morphism, that is, ® is the ideal of polynomials r ( 入 ） such that 
v{A )= ： 0. Now it is known that 到入 ] is a principal ideal domain.* 
By this we mean that every ideal in ^>[X] consists of the multiples 
of a particular polynomial. In particular 贷 = (#( 入 )） is the set 
of multiples of m ( 入 ) • The generator ^(X) is uniquely determined 
if we specify that its leading coefficient is 1. By the relation (1) 

W 1 - - Mol = 0. 

Hence we see that the polynomial 

(5) \ m - Mm-V 1 — Mm- 2 X m - 2 - /io 

which is 0 is in The result that we established before there¬ 
fore shows that 贷 〆 0. We now note that the polynomial (5) 
as determined by (1) is the generator 从 ( 入 ） of 贷 ； for otherwise 
there exists a polynomial of degree lower than m such that 
A r + v r ^.iA r ~ l + • • • + po = 0, and this contradicts the linear in¬ 
dependence of 1, A y … ， A r . 

We shall call the polynomial /x(X) the minimum polynomial of 
the linear transformation A. It is characterized by the following 
properties: 1) leading coefficient = 1; 2) \x{_A) = 0; 3) if ^(X) is 
any polynomial such that v(A) = 0, then v(X) is a multiple of 
M(X). 

The isomorphism between S and the matrix ring enables 
us to carry over to matrices the results that we have just de¬ 
rived. Let (a) be the matrix of A relative to (ei y e 2y … ， e n ). 
Then we know that the matrix of 戸 0 1 + + • •. + ^kA k rela- 

* See, for instance, Volume I, p. 100, of these Lectures. 
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tive to this basis is 0 O 1 + ^i(a) +. • . + It follows that, 

if the polynomial ju(X) given by (5) is the minimum polynomial 
of A, then 

m((«)) = («) m — - Mol = 0. 

Conversely, a relation in (a) implies a corresponding relation for 
A. This implies that /x(X) is the polynomial of least degree that 
has (a) as a root. For this reason we shall also call fx(\) the mini¬ 
mum polynomial of the matrix (a). 

EXERCISES 

1. Prove the rule {a^)(xy) = (oix)(^y) for any algebra. 

2. What is the minimum polynomial of an idempotent linear transformation 

一 0? 

3. Let 9? be the vector space of polynomials of degree < w — 1 with real co¬ 
efficients. Find the minimum polynomials of the differentiation operator D and 
of the linear transformation A such that JQC)A = /(X + 1). 

2. Cyclic subspaces. Of special interest in the study of a 
linear transformation A is the discovery of subspaces © that are 
invariant relative to A in the sense that they are mapped into 
themselves by A. If @ is such a subspace, then A induces a 
mapping in © and it is obvious that this mapping is a linear trans¬ 
formation. 

The simplest type of invariant subspace is an invariant sub¬ 
space that is generated by a single vector. Let w be a particular 
vector in 況 and let @ denote the smallest invariant subspace 
containing u. Since w e ©，so is uA\ hence also uA 2 = {uA)A, 
uA z = 、 uA 2 、 A, • • • • Thus 

[u, uA y uA 2 、 • • •] c ©. 

On the other hand, if v is any vector in the space [u y uA 、• • •]， 
then 

V = (XqU -f* Oi\UA + • . • + Oi r uA. T 
= 

where /(X) = a 0 + a x X + • • • + a r \ r . Hence vA = uf{A)A e [u y 
uA, •. •]• Thus this space is invariant，and [u y uA 、 uA 2 , …] is 
therefore the smallest invariant subspace of 9? containing the vec - 
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tor u. We now denote [u y uA 、•••] by {«}，and we call this space 
the cyclic space (relative to A) generated by the vector u. 

Suppose now that 以 〆0, and let uA' r > 1， be the first vec¬ 
tor in the sequence uA y uA 2 y - - - that is linearly dependent on 
the preceding. Then, as in the above discussion of the powers of 
A y we can conclude that 

(6) = [u y uA, • • • ， uA r ~ v \ 

and that (u y uA, • • 、 uA r ~~ 1 ) is a basis for this space. Also we 
have a relation of the form 

uA r = vqU + v\uA +. • • + v r _iuA r ~ 1 

or，what is the same thing, uix u {A) = 0 where 

(7) fjL u (X) = V — ^ r -iX r-1 - v Q . 

From the definition of r it is clear that ju u (X) is a polynomial ^ 0 
of least degree having the property = 0. We shall call 

Hu(X) the order of the vector u. 

Consider now the totality of polynomials v(\) such that 
uv{A) = 0. It is readily seen that is an ideal in $[X]. The 
polynomial /x M (X) of positive degree is in Su and is a non-zero 
polynomial of least degree in this ideal. It follows that — 
(Mu(X)). We observe finally that ( 入 ) is the minimum polyno¬ 
mial 〆 入 ） of the linear transformation induced by A in {u}. For 
if v is any vector in {u} y v = uf{A) so that 

v^ u (J) = uf{A)ix u {A) = = Of {A) = 0. 

Hence fx u (A) = 0 in {“} and therefore fi(X) | )u u (X). On the other 
hand, ufi{A) = 0. Hence /Z(X) e and so ijl u (X) | /2(X). These 
two relations imply that A ( 入） =Mu(X). 

If u = 0 y {u} = 0. In this case = (1), and we shall say 
that the order is 1. 

If ju(X) is the minimum polynomial of A, then ix{A) = 0 and 
uix{A) = 0. It follows that the minimum polynomial of is a 
multiple of every order jjL u (X)• 

3. Existence of a vector whose order is the minimum poly¬ 
nomial. Let ei y e 2y • • •，g be a set of vectors that generate 9i 
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relative to A in the sense that every vector x can be written in 

r 

the form x = ^2 for suitable 0 〆 入 ） in $[X]. Such finite 

l 

sets exist; for any ordinary basis {e u e 2 ^ . • . ， e n ) has this property. 
Let /i(X) be the least common multiple [ju ei (X), ju e 2 (X), • • • ， ^(X)] 
of the orders 〜 ( 入 ) • Since each 〜 ( 入 ） is a factor of the minimum 
polynomial /x(X) of / 2 (X) | /x(X). On the other hand ， if x == 
Xei(t>i(^), then 

x[l(A) = Heicj>i{A)pL{A) = ^ei[x{A)(j)i{A) = 0. 

Hence = 0 and this implies that jjl(X) | /i(X). Hence /x(X)= 
mW- Thus the minimum polynomial of A is the least common 
multiple of the orders of any set of generators. This generalizes 
the result established above in the cyclic case. 

We now write the ju ei (X) in terms of the same primes, say 

M ei W = 丌 1 ( 入产兀 2 ( 入产 …( 入 ) 

where the 7 r’s are distinct and kji > 0 . We may also suppose that 
the leading coefficients of the 7 r’s are all 1. Then if kj — max {kj\ y 
kj 2y . • kj r )y the polynomial 

n ( 入产 7T 2 (X 产 … 7T s (\) ka = /i(X) = ju(X). 

Now, in general, if the order 以 入） = …( 入 ) 从 2 ( 入 )， then the order 
of y = xiii{A) is M 2 ( 入 ). The proof is immediate. Applying this 
fact we see that, if k x = k li0 then the order of 

h = e il7 r 2 (J) k 〜 3 (J) k ^ … 

is 7ri(\) k \ Similarly, we can find a vector fj, j = 2 y , s, of 
order 717 ( 入 ) ' We shall now show that the vector 

/ = /l +/2 + … +/s 

has order ju/W ~ mW- This will follow from the following more 
general result: 

Lemma. If the orders ^(X) of fi y i = 1,2， • • •， 、 are relatively 
prime in pairs ， then the order 0 // = /1 + / 2 + • • • + / s /V the prod- 
uct p(\) = 
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Proof. Since /^{A) = 0 for each fv 、 A) = lhfiv{A) — 0. 
Hence m/(X) | ^(X). We note next that if pi(X) = M/ ( 入 ) M 2 ( 入 ) M 3 (X) 
… Ms ( 入 5 ， thtnfpi(J) = 0 a,nd/jPi(J) = 0 for ) = 2, 3 ，…， j. 
Hence，also fipi(J) = 0. This implies that Mi ( 入 ）| Pi(X). Since 
MiW is prime to M 2 ( 入 )， • • •，it follows that Mi ( 入 ）| M/ ( 入 ) • 
Similarly M 2 OO | M/(X) ， M 3 (X) | M/ ( 入 ) ，…. Hence v(\) = II/Xi ( 入 ） is 
a factor of m/ ( 入 ) • Thus M/(X) = K 入 )- This completes the proof. 

The above discussion now gives the following 

Theorem 1. There exists a vector in dt whose order is the mini¬ 
mum polynomial of A. 

We know that the degree of the order of any vector u is the 
dimensionality of the space {u}. Hence deg Mw ( 入 ) S Thus 
we have the 

Corollary. The degree of the minimum polynomial of A is < n. 

EXERCISE 

1. Use the method of this section to prove that, if m is the maximum order 
of the elements of a finite commutative group G, then x m = l for all x in G. 

4. Cyclic linear transformations. The space 況 is called cyclic 
(relative to A) and A is called cyclic (sometimes non-derogatory) 
if there exists a single vector e that generates 況 ， that is, dt : = {小 
We know that in this case ju(X) = /i e (X), and this shows that the 
orders of any two generators of a cyclic space are the same. It 
shows also that the minimum polynomial of a cyclic linear trans¬ 
formation has degree for if 5R = {e} y deg ju e (X) = dim 说 =n. 
Hence deg ijlQs) = n. 

Conversely, suppose A is any linear transformation whose min¬ 
imum polynomial has degree n. Then by Theorem 1 there exists 
a vector e such that /x e (X) = ju ( 入 ) • Then deg )u e (X) = n and so 
dim {e} = n. This, of course，means that {e} = We there¬ 
fore have the following criterion. 

Theorem 2. A linear transformation is cyclic if and only if its 
minimum polynomial has degree n. 

Suppose now that 9? = {e} and let 

M ( 入） = Me ( 入 ） = — Mn—iX n—1 一 • • . 一 Mo. 
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We know that the vectors (匕 eA 、• . • ， eA 71-1 ) constitute a basis. 
We wish to determine the matrix of A relative to this basis. 
Since 

eA = eA 
{eA)A = eA 2 
{eA n ~ 2 )A = eA n ~ x 

= ix Q e + fJLi(eJ) + • • • + Mn-i(d -1 )， 
the matrix we seek is 



If ju ( 入 ) = — Mn-iX n-1 — — ju 0 is any polynomial, then the 

n X n matrix given in (8) is called the companion matrix of m ( 入 ) • 
If, as in the present case, A is cyclic with minimum polynomial 
ju(X), then (8) is called the Jordan canonical matrix of A. Clearly 
the minimum polynomial may be read off from this matrix. 

We proceed now to derive a canonical matrix that displays the 
prime powers of ju ( 入 ) • We prove first 


Theorem 3. Let = {e} and /x(X) = Mi ( 入 ） • •. Ms ( 入 ） where the 
叫 [\) are relatively prime in pairs. Then dt = = {fi} ㊉㊉ • •. 
㊉ {〜} where fx ei (\) = Mi ( 入 ) • 


Let = ju(X)(A(X)) — 1 and let ei = evi{A). Then ^(X)= 
Mt(X). We know also that the order of 〆 =g + ••• + G is 
m(X). Hence {e f } — On the other hand, {e f ) C {e^ + {e 2 } 
+ • • • + {^s} so that dt = + {e 2 } + . • • + Since dim dt 

=degju ( 入 ）= 2 deg %( 入 ） = 2 dim the subspaces are 

independent. Hence 9?= = ㊉ ㊉. ••㊉ { 《 s}. 

Nowletjit(X) = ^ 1 (\)^ 2 (\)* 2 - - - 7r s (入卢 where the%are distinct 
primes. Then by Theorem 3 ， 9? = ㊉{ 以 }㊉…㊉ 

where = 以 入产 . 






_THE THEORY OF A SINGLE LINEAR TRANSFORMATION 71 

For the sake of simplicity of notation we assume for the mo¬ 
ment that s = l. Then mOO = 兀 ( 入 ) * where 7r ( 入 ) is prime, and if 

?r(X) = X 9 一 Pg— 1 入 9 — 1 — . • • — POy 

n = deg /x ( 入 ) = kq. We introduce the vectors 
/i = eir{A) k ~\ f 2 = eTr{AY~ l A y … ， f q = 作 ㈤ 灸 - 1 ，- 1 ; 
fq+i = eir (: A) k ~ 2 , f q+2 = eir{A) k ~ 2 A, / 23 = eir{A) k ~ 2 A q ~ 1 ^ 


/( fc _i )3+ i = e y /(^- 1) 3 +2 = eA, … ， f kq = eA q ~ x . 

Thus each / is of the form ecj>(A) where deg 0( 入 ） < kq. Moreover ， 
the degree of the 0( 入 ) ’s associated with distinct /’s are different. 
It follows that the/’s are linearly independent, since a non-trivial 
relation of the form = 0 entails the existence of a polyno¬ 

mial 入） 〆 0 of degree < kq such that ev{A) = 0. This contra¬ 
dicts the fact that deg ju(X)=〜and establishes the linear inde¬ 
pendence of the/’s. Since there are altogether kq ( 九九…， 
fkq) is a basis for 況 over ^>. 

What is the matrix of A relative to (/i ， / 2 ，• • •，/“）？ We have 
the following relations: 

f\A = f 2 

J2A = fz 


Jq—\A = fq 

f q A = eTr{A) k ~ 1 A q = eTr{A) k ~ l [A q - tt{A)] 

=+ ••• + Pq_iA q ~ l ] 
=Po/l + P1/2 + • • • + Pq-l/q 
/«+l^ = /fl+2 


A+2^ — fq+S 
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f2q—\A 


=/2 


Q 


f 2q A = eTr{A) k ~ 2 A^ = eir(J) k ~ 2 [J q - ir{A)] 

+ ew^jy- 1 

= Pofq+l + Plfq+2 + . • . + Pg-l /25 +/l 


J — 1) fl +1*"^ — f — 1)9+2 


J ~~ 1 ) 9+5 — 1 kq 

fkq^ = Pof(k-l)q + l + Pl/(fc-l)g+2 + •••+ Pq—\fkq 
+ f(k - 2 ) 3 + 1 . 


Hence the matrix of A relative to the basis ( 九 / 2 ， . • . ， Ag) has 
the form 


( 9 ) 



P 

N P 
N 


N P 


where P is the companion matrix of 7r(X) and N is the q X q 
matrix 



N 


0 0 
0 0 



0 

0 

0. 


We return now to the general case in which ju(X) = 7Ti(X) fcl 7r 2 (X) fc2 
… 入卢 and 況 = : pi} ㊉{。}㊉…㊉ {〜}• We choose in each 
{ei} a basis of the type just indicated. Together these bases 
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give a basis for 9?. 


( 11 ) 


The matrix of A relative to this basis is 

B, 1 

B 2 


B s \ 


where each Bi is determined by 7r*(X) fet in the same way that B is 
determined by 7r(X ) 气 

We shall call (11) the classical canonical matrix of the cyclic 
linear transformation A, The prime powers 7 ^ (入产 that occur in 
the factorization of the minimum polynomial will be called the 
elementary divisors of the cyclic linear transformation. To the 
elementary divisor is associated the block Bi in the classi¬ 

cal canonical form. As an example, let 中 be the field of rational 
numbers, and let ju(X) = (X — 1) 3 (X 2 — 2) 2 . The classical ca¬ 
nonical matrix of the cyclic linear transformation with minimum 
polynomial 从 ( 入 ） is 


1 0 0 

1 1 0 

0 1 1 



0 1 

0 0 


2 0 

0 0 


0 0 

0 1 



2 0 


EXERCISES 

1. Show that, if jn(X) is any polynomial with leading coefficient 1, then there 
exists a matrix (a) that has ju(X) as its minimum polynomial. 

2. Show that, if is a linear transformation that has the diagonal matrix 

diag {a h ot 2y ... ， « n } 

where the a{ are distinct, then the minimum polynomial of A is II(X — a*). Hence 
prove A cyclic. 
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3. Use 2 to prove that, if C is the field of complex numbers and fi, ^ 2 , • • •, f n 
are the n distinct roots of unity, then 


rfi 1 

f2 

• 

and 

"0 1 0 

0 0 1 

_ 參 • 

… O' 

… 0 

• • • • 

• 

• 

. fn. 


0 0 0 
.10 0 

• 0 1 
… 0. 


are similar in C n . 

4. Show that, if yf is a linear transformation with matrix 


ro 

1 

«13 * • 

• 

Oiln 

0 

• 

0 

• 

1 «24 - 

• • • 

• 

• 

OL 2n 

• 

• 

0 

• 

0 

• • • 

0 • • 

1 

鲁 

0 

• 

1 

0 

0 

0 - • 

0 

0 


then A is cyclic. Use this to prove that the given matrix is similar to 


'0 

1 

0 

• • • 

O' 

0 

0 

1 


0 

• 

0 

• 

0 

• 

0 

■ •争 

• 0 

• 

1 

.0 

0 

0 

• 0 

0. 


5. What is the classical canonical matrix of the cyclic linear transformation 
whose minimum polynomial is (X — 1) 3 ( 入 2 + 1) 2 ( 入 + l) 2 ? Assume 中 to be the 
field of real numbers. 

6. Prove that, if 況 ={d} ㊉ 卜 2 } ㊉…㊉ and the orders ^(X) are rela¬ 
tively prime in pairs, then is cyclic. 


5. The $[X]-module determined by a linear transformation. 

For the further study of a linear transformation we shall make 
use of another idea, namely, that the homomorphism between 
^>[X] and the ring 21 = [1 ， A, A 2 、 • • •] can be used to turn the vector 
space 9? into a $[X]-module. For this purpose we define the prod¬ 
uct 0( 入)％ in 9?， to be the vector Then 

0( 入 )0 + y) = (x + = </>(X)x + </>( 入 ) jy ， 

and since the linear transformations corresponding to 0( 入 ） + 沴 (X) 
and 0( 入 )4( 入 ） are respectively + and = 

沴⑶ 0 ㈤ ， 
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[0( 入 ） + 000k = ^[0(^) + 少 (yf)] = X(j>(J) + x\f/{A) 

=0(X)*v + \l/(\)x 

[0(X)^(X)]^ = x[yp{A)<j>{A)} = {x\!/{A))(j){A) = 0(X)(^(X)^) 

丄八—八丄 — i/w • 

Hence the basic module conditions hold.* There are several ad¬ 
vantages to be gained in adopting the module point of view. In 
the first place we replace the ring % by the ring 中 [ 入 ] • The for¬ 
mer may have quite a complicated algebraic structure; it may 
contain nilpotent elements and it may have zero divisors. On 
the other hand，we know that the polynomial ring $[X] is an in¬ 
tegral domain, and we have available the arithmetic theory of 
this ring. The basic arithmetic fact concerning $[X] is that every 
ideal in this ring is a principal ideal. 

A second advantage of the module point of view is that it 
leads us to the consideration of other 中 [ 入 ] -modules that are of a 
simpler structure than di and that can be used to study 9?. In 
fact we shall reduce our study of 9? to that of free modules and 
of submodules of free modules. This is accomplished in the fol¬ 
lowing way: Let (ei y fn) be a basis for 9? over Then, 

of course, the ei form a set of generators for 9? relative to $[X]. 
The $[X]-module 9? is not a free module since for any e s SR there 
exists a non-zero polynomial /x e (X) such that ix e (S) e = e f JL e(^) = 0. 

n 

Hence there exist relations of the form X) 7iW e i = 0 in which the 

l 

1 ( 入 ） are not all 0. In order to study these relations it is natural 
to introduce the free $[X]-module g with basis {t u t 2 y • • • ， AO. 
If v = is an element of g, then we associate with v the 

element vT = in 5R. This correspondence is a 中 [ 入 ]- 

homomorphism of g on 9?. Let 91 denote the kernel of this homo¬ 
morphism. It is immediate that is a submodule of g. By defi¬ 
nition 'EyiQCjti e 5R if and only if the relation 2%( 入 ) 心 = 0 holds 

* It should be noted that the commutativity of multiplication in 21 was used in the 
verification of the third axiom. We can also regard 9? as a right <l>[X]-module. Here 
X(f>(\) = x<f>(J). This is probably the more natural point of view. However, we have 
adopted the above method in order to be consistent with our previous emphasis on left 
modules. 
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among the generators ei ， Thus in a sense 況 corresponds to the 
set of relations that obtain among the ei. 

We can easily determine the submodule 9Z. Let €iA = 2a 的 
so that (a) is the matrix of A relative to the given basis. Then 
it is clear that the elements 

卩 l = ( 入一 aiiVi — ot\2h —…一 a ln t n 

,, 汽、 V 2 = —«21,1 + (X — a 2 2),2 — ... — a 2n tn 


v n = ~~OL n \t\ — a n 2^2 ― * * * + (X — a nn )t n 

are in 91. We shall now show that 91 is free and that the v's form 
a basis for this module. The definition Vi = 入々一 2a r -/y gives 
\ti = Vi + These relations can be used to express any 

element v = 20 夂入 ) in the form + 2p,/ 2 - where the 

Pi e<l>. Clearly if v then 2p^- e yt. Hence = (Zp/i) T 

= 0. But the e{ are 伞 -independent，and this implies that every 
Pi = 0. Hence v = 私 which shows that the Vi are genera¬ 
tors for 沢 . Suppose next that 2\^( 入 ) 〜 = 0. Then 

and 

^i(X)X = X 

j 

If any A # 0, let be one of maximum degree. Then clearly 

the relation ^ r (X)X = ^ ^-(X)ay r is impossible. This proves that 

j 

the Vi form a basis for 91. 

6. Finitely generated o-modules, o, a principal ideal domain. 

There is still another advantage of the module theoretic method: 
It is easily generalized. In place of 到入 ] we can consider any 
principal ideal domain o and any finitely generated o-module 5K.* 
With a slight increase in difficulty we shall obtain in this way 
other important applications. The most noteworthy of these is 
the theory of ordinary finitely generated commutative groups. 

* A good deal of what we shall do can also be done for 0-modules for which 0 is a non- 
commutative principal ideal domain. This theory can be applied to the theory of a single 
linear transformation in a vector space over a division ring. See the author’s Theory of 
Rings, New York, 1943, Chapter 3. 
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As we have noted in Chapter 1 ， this theory can be obtained by 
regarding commutative groups as o-modules for o, the ring of 
rational integers. 

Hence let 況 be any finitely generated o-module and let 
• • • ， e n ) be a set of generators. Following the procedure that we 
used above we introduce the free module g with basis (/ ly / 2 > • • •， 
t n ) and the mapping T: 々一 > 20 而 . The mapping T is an 

o-homomorphism. Hence the kernel 況 is a submodule of We 
shall now show that any submodule of a free o-module, o princi¬ 
pal, is free. It is convenient to use the convention that the mod¬ 
ule 0 is a free module with a vacuous basis. 

Thus let 況 be any submodule of the free module § with the 
basis (,i ， 4 ， . . • ， tn)- We shall show by induction on n that 況 is 
free and has a basis oi m < n elements. This is clear if w = 0 . 
Hence we assume it true for modules % r with bases o{ n — \ ele¬ 
ments. We consider now the totality 3 of elements /3i of o such 
that /?i,i + AG + • • • + & J n e 91. It is immediate that 3 is an 
ideal; hence 3 = (5i). If = 0 every element of 91 is of the 
form 02^2 + • • • + and therefore it belongs to the free mod¬ 
ule with the basis (/ 2 , tn). In this case the result is 

n 

clear. Now assume that 心 〆 0 and let Vi = 5+ 2 ft%- be 

2 

an element of 91 that has the ‘‘leading coefficient” 5i. Then if 
v is any element of 況 ， and = MiSi. Hence v f = 
v — fiiVi e g’. Of course this element also belongs to 9^. Now the 
intersection 沢’ = 況 fl g’ is a submodule of g’，and so we can 
assume that it is a free module with the basis v 2y v Sy … ， v my 

m 

m <n. Then v f = ㈣ k and v = /jliVi + 'ZfikVk- Hence (v ly 

k = 2 

m 

v 2y • • • ， v m ) is a set of generators for Suppose next that Pi v i 

1 

= 0. Then if we replace Vi by 5i/i + 2/3/ 心 . and the other v's by 
their expressions in terms of , 3 ， •••，,》we obtain 

P 1 S 1/1 + P2’,2 + • • • + Pmt m = 0. 

n 

Since 〆0， this implies that pi = 0. Hence we have 2 pkVk 

2 

= 0 from which we conclude that all the p，s are 0 since the ele- 
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ments (v 2y v 3y •••， v m ) form a basis for 5 R’. This concludes the 
proof of the following 

Theorem 4. If % is a free ^-module with a basis of n elements 
and o is a principal ideal domain, then any submodule of % is free 
and has a basis of m < n elements. 

7. Normalization of the generators of g and of 5 R. We shall 
suppose now that the elements ( 〜， v 2 , • • • ， v m ) are merely genera¬ 
tors for the submodule 9 ^ of the free o-module g with basis (,i ， 
… ， 4 ). We write 

Vi = (Tut i + O' 12,2 +•••+〔 lv/n 
^2 = 721,1 + 0 * 22,2 + . • . + ^2ntn 

(13) 


V m = <^mlh + 江 m2h + •… + 

The matrix (a) with elements in o is uniquely determined by 
the ordered sets • • • ， v m ) and (,i ， 4 ， … ， AO. 

Let (idij) be a unit in the matrix ring and let the inverse matrix 
be (m"*). Define // = Then we assert that the ti con¬ 

stitute another basis for In the first place we have the relations 

i，j 

Hence any element 2 <may be written in the form 2 ^^/ and 
the ti are generators. Next suppose that 27 // = 0 . Then 
ynjiijtj = 0. Hence X) = 0. But this implies that 

i,j i 

7k = = 0 , 

ij 

and this proves that the t/ form a basis. 

In a similar fashion we see that if (v pq ) is a unit in then the 
elements v p f = ^v pq v q constitute a second set of generators of 91. 

Suppose now that the basis (/ 1 , t 2y •••，/ w ) is replaced by (//， 
t 2 y • • • ， t n f ) where ti = (M) a unit，and that the set of 

generators (^i, v 2y • • .， v m ) of 9^ is replaced by (y /， v 2 \ • • •， v m r ) 
where v p f = 'Ev pq v q . What is the matrix of (vi\ v 2 \ ••• ， v m ’) 
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relative to (//, t 2 \ … ， t n r ) ? We have the relations 


Vp 

= ^pq^q == ^pq^qi^i == ^ : ^pq^q il^ij 

q qaJ 

f 


= ^iTpjtj y 


where r p j = 

VpqfTqijjLij^. Thus the new matrix is 

related to 

0) by 



(14) 

0) = 0)(>)(M) _1 . 


We are now led to the problem of making the “right” choices for 
the units (v) and (/x) -1 so that the matrix (r) has a simple ‘‘nor- 


mal” form. 

8. Equivalence of matrices with elements in a principal ideal 
domain. Two m 乂 n matrices with elements in o are said to be 
equivalent if there exist a unit (/x) in o n and a unit (v) in o m such 
that 

W = 0)0)0). 

This relation is an equivalence. The special case in which o is a 
field has been considered previously. Here we learned that a 
necessary and sufficient condition that (a) and (r) be equivalent 
is that they have the same determinantal rank. A consequence 
of this result for the general case of an arbitrary principal ideal 
domain is that a necessary condition for equivalence is equality 
of ranks. For let (r) = (^)(o-) (jn) y where (/x) and (v) are units. 
Then if P is the quotient field of o y then the given equation may 
be regarded as a relation between matrices with elements in P. 
Clearly (m) e L(P y n) and {v) e L(P, m). Hence by the result in 
the field case (r) and (a) have the same determinantal ranks. 

We consider now the problem of selecting among the matrices 
equivalent to a given m X n matrix (o-) one that has a particularly 
simple form. The result that we wish to obtain is the following 

Theorem 5. If (o*) is an m X n matrix with elements in a prin¬ 
cipal ideal domain o, there exists a matrix equivalent to (a) which 
has the “diagonal” form {cf. (18), p. 45) 

diag {5 1? S 2 , ••• ， 5 r ， 0, • • • ， 0} 
where the S{ are ^ 0 and | Sy {hi is a factor of 5y) if i < j. 
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(a) We give first a constructive proof of this theorem which is 
valid for the case where o is Euclidean. We recall that a commu¬ 
tative integral domain is called Euclidean if there is defined a 
degree 8(a) for every a in the domain，such that h{a) is a non¬ 
negative integer and such that 

1. 5(^) = 0 if and only if a = 0. 

2. h{aF) = 8(a) d(i). 


3. If a is arbitrary and 彡 〆0， then there exist elements q and 
r with S(r) < b{b) such that a — bq r. 

We refer the reader to Volume I, p. 123, for the proof of the fact 
that any ideal in a Euclidean domain is principal. We proceed 
now with the proof of the theorem. 

We note first that the square matrices 


TijiP)= 


13 


「1 


Di(y )= 


7 
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where i 7 ^ j and 7 is a unit in 0 and 



are units; for T" ⑻一 1 = andPi 厂 1 = 

Pij. It is easy to verify that 

I. Left multiplication of (a) by an m X m matrix Tij(0) gives 
a matrix whose ith row is obtained by multiplying the jth row of 
(a) by and adding it to the ith row and whose other rows are 
the same as in (<r). 

Right multiplication of (<r) by an « X « matrix T t y(/3) gives a 
matrix whose jth column is j3 times the hh column of (<r) plus the 
jth column of (o*) and whose other columns are as in (<r). 

II. Left multiplication of (<r) by an m X m matrix Di(y) 
amounts to the operation of multiplying the ith row of (<r) by y 
and leaving the other rows unchanged. 

Right multiplication of (<r) by an n X n matrix Di(y) amounts 
to the operation of multiplying the /th column of (a) by 7 and 
leaving the other columns unchanged. 

III. Left multiplication of (a) by an m X m matrix amounts 
to interchanging the /th and jth. rows of (<7) and leaving the re¬ 
maining rows unchanged. 

Multiplication of {o) on the right by an w X w matrix Pij 
amounts to the interchange of the ith and )th columns of (a). 
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We refer to the matrices Tij, D“ P" as elementary matrices, 
and multiplication by these matrices as elementary transformations 
of the respective types I, II and III. Any matrix that is ob¬ 
tained from (a) by a finite sequence of elementary operations is 
equivalent to (cr). We now proceed to the main part of the proof. 

If (a) = 0, we have nothing to prove. Otherwise let aij be a 
non-zero element of least degree in (o-). Elementary transforma¬ 
tions of type III will move this element to the (1,1) position. If 
(T\k = crii(3 k + Pik where the degree d(p lk ) < 6(c7n), then we may 
use an elementary transformation of type I to replace aiu by p lk . 
If pik 9 ^ 0, we have a new matrix equivalent to (cr) in which there 
are non-zero elements of degree less than the minimum non-zero 
degree in (a). We repeat the original process with this new ma¬ 
trix. Similarly if a k i = cr 11 /3^ / + p ki where d(p kl ) < d(an) y then 
either p^i = 0 or we obtain a matrix equivalent to (<j) that has a 
non-zero element of degree less than the minimum 5(o\y) 〆 0. 
Since the minimum degree ¥ 0 is constantly decreasing, we even¬ 
tually reach a matrix in which = (Tn^k and = cru^k for 
all k = 1 ， 2 ， • • 、 n. Then elementary transformations of type I 
yield an equivalent matrix of the form 

0 … 0 ' 

P22 • • • P2n 

» Pll = CTii ， 

• 參番參 擊 

Pm2 * Pmn- 

This process can now be applied to the submatrix (p") / = 2, 
• • •, m; j = 2^ •••)?!• The necessary transformations do not 
affect the first row or column, and yield an equivalent matrix of 
the form 

>u 0 • 

0 T 22 0 

0 0 r 33 

• • 參 

0 0 r w3 

Continuing in this way we obtain finally an equivalent matrix of 
diagonal form，say diag {ei, e 2y • • •, e r , 0, … ， 0} where the €i ^ 0. 


0 

0 

^ 3n 


(15) 


P11 

0 

0 
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If €i = 6x(3 + pi with 8(pi) < 6 (ei) and 〆0, then we may re¬ 
place our diagonal matrix by the equivalent matrix 

€i • • • €i • • • • 

• • 

• • 

• 參 

ei • 

V • 

This is equivalent to a matrix in which the element in the (1, i) 
position is pi. We then repeat our earlier process to “diagonalize” 
this matrix. We obtain a new matrix diag { 771 , 772 , ••• ，〜， 0 , • • 0 } 

in which 5(?^) < 5(ei). A number of repetitions of this process 
leads eventually to an equivalent diagonal matrix, diag {5i, d 2y 
• • •， d n 0, • • • ， 0 } in which the non-zero elements satisfy the 
required divisibility conditions. 

(b) The argument in the general case is similar to this. Here 
we use the length of an element, that is, the number r of primes 
in that occur on a factorization of the element as wi7r 2 • • • 
as a substitute for the degree used above. This number is an 
invariant because of the unique factorization theorem in 0 (cf. 
Volume I, p. 122 ). Suppose that an has smallest length for the 
non-zero elements and suppose that an ^ Write a = <Tn y 

/3 = cri/b and let 5 be a highest common factor of a and Then 
there exist elements rj such that af + = 5. Set f = ^5 — 、 

d = —a5 -1 . Then we have the matrix relation 


•—e r 


飞 r 


1 O' 

- V 一 t 


.77 6 - 


.0 1. 


Thus these matrices are units; consequently 

* a X ^ means “a is not a factor of b. y * 
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is a unit. The matrix (a) U has as its first row the vector (5, a 12j 
0 * 13 ，• • • ， 0, crKfc+i), • • • ， <r ln ). Since a/l’/S，the length 
of 5 is less than that of a = an ， Eventually this process and a 
similar one applied to the first column yield a matrix equivalent 
to (a) in which an is a factor of each and of each a k i. As 
before, this leads to a matrix of the form (15). The remainder 
of the argument is a repetition of the one given above. 

A matrix equivalent to (a) that has the form given in Theorem 5 
is called a normal form for the matrix (<r). The diagonal elements 
of a normal form are called invariant factors of (a). We shall 
show in § 10 that they are，in fact, invariants of the given matrix. 

EXERCISES 

1. Obtain a normal form for the matrix 

6 2 3 On 

2 3-41 
-3 3 1 2 

一 1 2 — 3 5. 

0 = 1 the ring of integers. 

2. Obtain a normal form for the matrix 

8 12 -14' 

入 + 22 35 -41 

一 1 X - 4 4 

2 2 X 一 3 - 
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0 = i?o[X], Rq the field of rational numbers. Also find units (jjl) and (v) such that 
WW(m) normal form. 

3. Prove that a diagonal square matrix, diag {5i, h 、•••，〜} is a unit if and 
only if every is a unit. 

4. Use 3. to prove that, if 0 is Euclidean, then any unit in o n is a product of 
elementary matrices. 

5. Show that, if J is a greatest common divisor of the elements ai y a ny 

then there exists a unit (jix) in 0 n such that («i, a n )(jji ) : =« 0 ， … ， 0). 

6. Show that, if the elements an, an, … ， a\ n are relatively prime (have 
greatest common divisor = 1)，then there exist elements a ijy i = 2, - - *, nj = 
1, 2, •••，》，such that {a) is a unit. 

9. Structure of finitely generated o-modules. In order to state 
the structure theorems it will be well to introduce some general 
concepts concerning o-modules. Some of these have already been 
encountered in the special case of modules determined by a linear 
transformation. 

Let x be any element of the o-module 5R. Then the set of 
elements 0 e o such that = 0 is an ideal. We call this ideal 
the order ideal of the element x. If o is a principal ideal domain ， 
= (/x x ). Moreover, if o = ^>[X] and 9 ^ (0)，then we may 
normalize \x x to have leading coefficient 1. The n x thus obtained 
is the order that we have considered before. 

The totality of multiples ax of the fixed element x in 沉 is 
a submodule. We call the cyclic submodule generated by x 
and we call 9? cyclic if there exists an e such that 9? = {e}. If 
= (0)，the submodule {%} is a free module. In the contrary 
case 〆 (0) we say that x is of finite order. 

If y = ax and e Q xy then fiy = /3ax = afix = 0. Hence 

^ e 3 y and so Ifjy is a second generator of then also 

Q Hence = Q y . Thus the order ideal depends only 
on the cyclic submodule and not on the particular generator of 
this submodule. 

A module 9? is said to be a direct sum of the submodules 9 ^， 
況 2 ， • • •， 5Rs if 

(16) 況 = 沁 + 況 2 + ••• + 

in the sense that 沉 is the smallest submodule containing all of 
the and 

(17) fl (5Ki + • • • + + 9?i+i +. • • + 9? s ) = 0 
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for / = 1 ， 2， • • • ， j. If these conditions hold，we write di = dti 
㊉ 況 2 ㊉ • • • ㊉ 況 s. As in the case of a vector space 9? = ㊉ 沉 2 

® * * * ® if and only if every x in dt may be represented in one 
and only one way in the form + x 2 + • — + x s where Xi e 礼、 
We may now state the following fundamental structure theo¬ 
rem for o-modules 3 o a principal ideal domain. 

Theorem 6, If o is a principal ideal domain, any finitely gener¬ 
ated ^-module is a direct sum of cyclic submodules. 

Proof. Let e 2y • • be a set of generators for 況 . As 

above，we introduce the free module g with basis (/ 1? t 2y • . .， t n ) 
and the o-homomorphism T: 2</> 而 of g onto 況 . Let 沢 

be the kernel. Then we have seen that 9J has a basis oi m < n 
elements. For our purpose here we shall require only the weaker 
result that 91 is finitely generated. Let (vi y v 2y • • • ， v m ) be a set 

n 

of generators and let Vi = ^2 汀 ijtj y i = 1 ， 2,… ，所 ， be the rela- 

i== 1 

tions connecting the vs and the /’s as before. We now replace 
the /’s by . • .，O and the y’s by v 2 f y • • vj) where 

ti = v v f = Hiv pq v q and (fx) and (v) are units. Then the 

matrix of the new set of generators (vi y v 2 \ • • • ， v m f ) of 9^ relative 
to the new basis (//，/ 2 ’，• . .，/ n ’）of g is We choose 

the units (jjl) and (p) so that (v) (a) (ju) _1 has the normal form 
diag {Si, 8 2y • . • ， U ， 0， •••，（)}• The relations connecting the 
new generators now read 

(18) V\ — h\t\ ^ V 2 — 谷 2 【 2 ’， • • •, v/ — d r t/y 

Vr+l = 0 ， … ， V m f = 0 . 

Now define e/ = Then since (m) is a unit these elements 

are also generators of 9?. We assert that 

(19) 況 = { 《 1’} ㊉㊉ • . •㊉ {^n} 

and that the order ideal of {e/} for / < r is while for i > r 
it is (0). Since the e/ are generators, (16) holds. To prove (17) 

n 

we must show that, if ^ Aa’ = 0， then each ^e/ = 0. Since 

l 

t/ = tiT = e/. Hence 2/3^ / = 0 implies that 2/3^ / e 9^. 



THE THEORY OF A SINGLE LINEAR TRANSFORMATION 


87 


n r 

Since the v/ are generators of 況 ， this means that — 22 7j v /- 

l l 

Hence 

+ 尽 2,2’ + . • • + 3r/n’ = 4~ 1^2,2’ + • • • + 7r^r^r ， . 

Since the t/ form a basis for % y this implies that 

Pi = jidi for i <r and Pi = 0 for i > r. 

Thus certainly / = 0 for i > r. Moreover, since v/ e 91 and 
v/ = biti for i < r, v/T = 5^ / = 0. Hence also ^e/ = yAa’ = 
0 for i < r. This proves our first assertion and completes the 
proof of Theorem 6. 

We have also shown that = 0 for i > r implies that 氏 = 0. 
Hence the order ideal 3 e/ = (0). Moreover, we saw that，if 
i < r y then /3^ / = 0 if and only if is a multiple of 5^. Hence 
for these i ， s y 3^' = (H This proves the second assertion made 
above. 

There is another interpretation of our results that we now give. 
We observe first that a direct sum of cyclic submodules such as 
{e r +i} y • • • ， {^n} in which the generators e/ have order 

ideal = (0) is a free module. For if ^ r+ ie r+ i + ^ r+2 ^r -\-2 + • . • 
+ — 0^ then each Pje/ = 0 and since = (0) ， ft. = 0. 

We note next that the subset @ of 況 of elements of finite order 
is a submodule. For if jyi ， J 2 e © and fiiyi = 0 for 仏 〆0， then 
卢 lACyi — 力） = 0 and 0. Also if jy e ©, then ay e® for 

any a. We shall now prove that the submodule © = M ㊉ 
{e 2 f \ ㊉* ••㊉ {^r} that consists of all linear combinations a〆/ 
+ 0 ^ 2 ’ + • • • + oi r e r r is precisely the submodule © of elements of 
finite order in 9?. Since each e/ y i — 1 ， 2， • • . ， r，is in ©，© S 
On the other hand, let y = a\e\ + oi 2 e 2 f + ••• + a n e n f e 
Then there exists a 〆 0 such that 

Poi X ei + 0a 2 e2 + • • • + ^0L n e n f = 0 . 

We have seen that this implies that = 0 for j > r. Hence 
ocj = 0 for y > r and ye®. Thus @ = ©. Now it is clear that 
況 = ©㊉ {e r+ i) ㊉. ••㊉ {e n f ) = ©㊉® where® = Ur+i} ㊉ • • • 
㊉ {en} is free. This proves the following 
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Theorem 7. If o is a principal ideal domain，any finitely gener¬ 
ated o-module is a direct sum of the submodule of elements of finite 
order and a free module. 

We note finally that in the decomposition 9? = pi’} ㊉ {e^} 
㊉…㊉ M we may drop the terms {e/} whose order ideals 
are (dj) = (1). If there are h such terms, we write ^ + / = fj y 
j = 1 ， 2 ， •••，/， where t — n — h. We shall also denote the num¬ 
ber r 一 k off f s of finite order by u and the number n — r of the 
remaining/’s by v. Finally we change the notation d h+ j to 8j. 
Then 

(20) 9? = {/ 抽 {/ 2 } ㊉…㊉ {/d 

where 

(21) 3 /y = ⑹， ）= 1， • • •，“； 3 /jfc = ⑼， 

k = u + l y • . 、 t and dj I djf if j < j r . 

For the case of an ordinary commutative group our results 
specialize to the following theorems. 

Theorem 8. Any finitely generated commutative group is a di¬ 
rect sum of cyclic groups. 

Theorem 9. Any finitely generated commutative group is a di¬ 
rect sum of a finite group and a free group. 

The finite group is © = {/l} ㊉ {/ 2 ! ㊉…㊉ {/u}- Its order 
is 8 J 2 ••- d u if 8 j is normalized to be positive. 

10. Invariance theorems. In this section we prove that the 
order ideals ⑷ ) ， (5 2 ), • • (d u ) and the number v = t — u of/’s 
in the free part {f u +i\ ® {fu+ 2 } ©•••©{/<} are invariants. 
We discuss first some more ideas concerning o-modules which 
will be needed for the proof. 

Let 9t be an o-module and let © be a submodule and 9?/© the 
factor group of cosets x + If a e 0 and ^ + © e 9?/©, we de¬ 
fine a(x + ©) = + ©. Then since © is closed under scalar 

multiplication, the result ax + ® given here does not depend on 
the choice of the representative x in the coset x + It is 
readily seen that 況 /© becomes an o-module relative to this defi- 
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nition of scalar multiplication. The proof is the same as for vec¬ 
tor spaces (cf. § 9, Chapter I). We note also that, if 5R is finitely 
generated with generators e 2y • . e ny then 況 /© is finitely gen¬ 
erated with generators + ^2 + •••，〜 + ©• 

We suppose next that 33 is an ideal in 0 having the property 
that = 0 for all e S and all ^ e 5R. Let a = a ： + S3 be a 
coset in the difference ring 0 = o/S. Then we define ax = ax. 
If a = a l5 then a — e 33. Hence ax = {a\ + = a i x - 

Thus ax is a single-valued function of a in 0 and x in 9?. It is 
easy to verify that 況 is an 5-module relative to this function. 

We give now the invariance proof which we shall break up into 
several stages. First let 9? = g be a free module with basis (/ 1 ， 
f 2y • • • ， 广 n ). Let 91 be a submodule and suppose now that 
u 2 , ••• ， v m ) represents a basis for 9^. Then the new elements 
ti y v p f used in the proof of Theorem 6 form bases for % and 9^ 
respectively. We have the relations (18) connecting these ele¬ 
ments. Now since no element of a basis can be 0, clearly r = m 
in (18). Hence the number of t y s is not less than the number of 
y’s. Consequently m < n. If we may reverse the roles 

of the t r and the 〆 and prove that m — n. This proves that the 
number of elements in any basis of a free o-module, 0 a principal 
ideal domain is an invariant. As for vector spaces we call this 
number the dimensionality of the free module. 

Assume next that every element of 9? = @ has finite order. 
Let 

© = {/ 1 ’} ㊉ {/2’} ㊉…㊉ {y/} 

be a second decomposition into cyclic submodules such that 
= (5 J - / ) ^ (0) and 5 / | dk for j < k. We wish to prove that 
/ = 〆 and that (6y) = (d/) for j = 1, 2, •••，/• We define the 
length of a decomposition @ = {/ 1 } ㊉ {, 2 } ㊉…㊉ {/<} to be 
Xsiy where Si is the length of Si ， We suppose that the first de¬ 
composition has minimum length, and we shall prove the theo¬ 
rem by induction on this minimum length. 

Let 7r be a fixed prime and let denote the subset of elements 
jy in © such that iry = 0. is a submodule of ©. Suppose that 
y = e ©’• Then Hwyifi = 0. Hence irji is divisible by 

This implies that either 5 t * | ji or x | 5*. In the former case jifi 
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= 0 ， and in the latter ji is a multiple of e t -= 心 7r _1 . Thus y 

t 

has the form Pj e jfjy where h is the smallest integer such that 

h 

8h is divisible by 7r. This shows that 

©’ = ㊉ { ㊉.••㊉ { ^tft] • 

Similarly, 

= { 〜 ’/〆} ㊉…㊉ 

Since every element of & satisfies the equation wy = 0, & may 
be regarded as an o-module, o = o/ (x). Since tt is prime, we 
know that o is a field. (Vol. I ， Ex. 2 ， p. 122.) Hence & is a 
vector space over o. Hence by the theorem on invariance of 
dimensionality (or by the above result for free modules) the num¬ 
ber of base elements in the two decompositions is the same. 
Thus t — h = t r — h r . 

Now choose 7r to be a divisor of 5i. Then h = \ and the equa¬ 
tion t — h = t ’一 h! shows that t r > t. Similarly if tt is chosen 
to be a divisor of 5 /， then we obtain t > t r . Hence t = t f . We 
now see that, if tt is chosen to be a divisor of then h = l im¬ 
plies that h f — Thus w is also a divisor of 5/. 

We consider next the submodule 7r@. The argument just used 
shows that 


(22) 7T@ = 卜 /4㊉ Wfk+l) ㊉…㊉ Wft] 

= { 以 ’}㊉ Wfk f +l] ㊉…㊉ Wft] 

where k and k r are respectively the smallest integers such that 
dk and 8 k f are not associates of t. Then the order ideals of irfi 
are (ei) and those of irfi/ are (€〆)，and the ei and the e〆 satisfy 
the divisibility conditions. We can now use the induction hy¬ 
pothesis on the length of the module to conclude that t — k = 
t — k r and that (e k ) = (e〆) ， (e/c+i) = (ep+i’)，• • • • These rela¬ 
tions imply that also (D : =(V) ，⑹ = : (5 2 ’)，• • •• This proves 
the invariance of the (8i) for the module 

We consider finally the general case. Then if @ is the sub- 
module of elements of finite order，the result just proved shows 
that the number a of 乂 • of finite order is the same as the number 
u r of //of finite order. Moreover, we have (S z ) = (5/) for the 
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corresponding order ideals. Now consider the module 9?/©. It 
is easy to see that this module is free with basis f u +i + ©, • • •， 
f t + @ and also with basis f u +i + ©，• • •，/〆 + ©• Hence by 
the result proved for free modules, t 一 u = t’ 一 u. This com¬ 
pletes the proof of the following 

Theorem 10. Let dt = {/i} ㊉…㊉ iA} = {fi) ㊉. ••㊉ 
{//} be two decompositions of anmodule ，o a principal ideal 
domain，into cyclic modules ^ 0. Assume that the order ideals 
satisfy conditions (21) and analogous ones for the //• Then t = t r 
and 3 fi = 3/^, / = 1 ， 2， •••，/• 

The module theorem just proved can be used to prove the 
uniqueness up to unit factors of the invariant factors of a matrix. 
Thus we have the following 

Theorem 11. If dtag { d 2y • • 5 r> 0, •••，（)} and diag {5 /， 

S 2 ’，• . •， d r ，’， 0, •••，（）} are equivalent m 乂 n matrices with elements 
in a principal ideal domain o and \ dj for i < j, 8^ | d/ for k < l y 
then r = r f and hi is an associate of 3/ for i : =1 ， 2, … ， r. 

Proof. Let g be a free module with basis {t u f 2 y . • •，and 
let 91 be the submodule generated by V\ = S^i，• • • ， v r = 
y r+ i = 0, • • • y v m = 0. Then is a direct sum of cyclic mod¬ 
ules whose order ideals are (5 2 ), . • (5 r ) and a free module 

of n — r dimensions. On the other hand, the assumption of 
equivalence implies that we can find a new basis (ti\ / 2 ’ ， … ， A/) 
for 汧 and new generators v x f = SiV/, v 2 f = •••，= 

b r ，’t T \ v rf+ i =0， . • •，= 0 for 沢 . This gives a decomposi¬ 
tion of 5/91 as a direct sum of cyclic modules with order ideals 
(5/), ( 谷 2 ’)， • • • ，（ 5 r 〆）and a free module of n — r’ dimensions. 
Since the divisibility conditions hold, we conclude from Theo¬ 
rem 10 that r = r’ and (5 Z ) = (5/) for the (S^) 〆 （ 1). This im¬ 
plies (Si) = (S/) for all i. 

We shall give next a second and purely matrix proof of this 
result. At the same time we shall obtain some useful formulas 
for calculating the invariant factors. 

We observe first that, if {v) is any m 乂 n matrix, then the rows 
of {y) (a) are linear combinations of the rows of (<r). Hence for 
any) ， the^-rowed minors of are linear combinations of the 
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j-rowed minors of (a). Similarly the 7 -rowed minors of (oj(ju) 
are linear combinations of those of (or). Combining these two 
results we see that the j-rowed minors of {v)(a) (/jl) are linear 
combinations of those of (<7). Now let Ay(cr) be a highest com¬ 
mon factor of the j-rowed minors of (a). Then our result shows 
that, if (r) = (y) {a) (/x) 3 then Aj(a) | Ay(r). If (fi) and {v) are 
units，then also Ay(r) | Hence Ay(r) and Ay(o-) are asso¬ 

ciates. We apply this now to the equivalent normal forms 

diag {5 l3 8 2y - - 8 ry 0 y • • •, 0 } 

diag {5/, 8 r / y 0 y •••，（)}• 

Denote the Aj for these matrices by Ay and △/ respectively. 
Then because of the divisibility conditions on the 5’s and the 
d n s, we may take 

Ay = 5 i 52 ••- and A/ = W • . • 各 /• 

Since Ay is an associate of △/ for each 乂 it follows that r = r\ 
Also Ai = di is an associate of A/ = 5/. Since di8 2 is an asso¬ 
ciate of 8i / 8 2 / we also have that 62 and b 2 f are associates. Con¬ 
tinuing in this way we see that 8{ and 8/ are associates for each 
i. We have also proved the following 

Theorem 12. Let Ay(<r) be a highest common factor of the j -rowed 
minors of (a) and suppose that Ay(cr) ^ 0 for j ^ r. Then the 
elements — Ai(o-), d 2 = A 2 ((r)Ai((r)~ 1 y • • •, 5 r = A r (cr)A r _i((7) - " 1 
constitute a set of invariant factors for (o-). 

11. Decomposition of a vector space relative to a linear trans¬ 
formation. We return now to the consideration of a linear trans¬ 
formation A \n 2 l vector space dt over <i>. We apply the above 
results to the ^>[X]-module 9 ? determined by A. Since every vec¬ 
tor x has an order ( 入 ） # 0 , ^ = {/dW/ 2 } ㊉…㊉ U} 
where Q fj = (5y) 9 ^ ( 0 ), 7 ^ ( 1 ) and | 8 h if j < h. The invariant 
factor ideals (8j) are uniquely determined. 

If (e\y e 2y • • • ， e n ) is a basis for 況 over $ and e《A = 
then (a) is the matrix of A relative to this basis, and the elements 
Vi = ^Loujtj ——form a basis for the kernel 況 of the homomor¬ 
phism T between the free module g and 9 ?. Hence the matrix 
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that must be normalized to obtain the invariant factor ideals is 


(23) 


(cr) = XI — (a)= 


X — oil i 
—«21 


— «12 
入 _ <^22 


l 一 Oin\ — a n2 

The normal form of this matrix is 


— Oi2n 

入 - Oi n n- 


(24) 


diag {1 ， 1 ， d ly S 2y - - d t \ 


where it is assumed that the leading coefficient of = D) is 1. 
Our results show us also how to obtain a set of/’s such that 9?= 
{/i} ㊉ {/ 2 ) ㊉ • •. ㊉ {/<}• If (m) and (v) are units such that 
(^)(ct)(m) is the normal form, and e{ — （ m*) = (M ) -1 ， 

then we may take fi = e n ^ t +i- 

We obtain a ^-basis for 9? by stringing together 中 -bases in the 
cyclic subspaces { fi ]. If the degree of hi is then (/“/〆 ， 
.• •，/ is a basis for {/]• Hence 


(fu/iA … ， A， 1 — 1 ; h ， 


• • 


• m • 




: 一 1、 


is a basis for dt over 中 . The matrix of A relative to this basis 
has the form 

B 2 


(25) 


B t ) 


where the diagonal block Bi is the companion matrix of 〜 ( 入 ) • 
The matrix (25)，which is completely determined by the invariant 
factor ideals, is called the Jordan canonical matrix of A. 

A more refined canonical form can be obtained by applying 
the following considerations. Let 

8 i ( X )= ，“(入产 V 。 (入产 2 …丌如(入产 

be the factorization of di into powers of distinct prime factors. 
Then by Theorem 3, p. 70, [ fi] = {/“} ㊉{ 力 2 !㊉…㊉ { fi Si } 
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where the order of/" is We choose now a basis in each 

{ fa] of the type given on p. 71. These bases together give a 
basis for dt and the matrix of A relative to this basis is 


(26) 


C x 

C 2 




where Ci has the same dimensions as Bi in (25) and 


(27) 


Ci 


C%] 


Ci2 


where 


r tS% J 


(28) 


^3 


PiJ 

Nij P ij 
N {j 


kij blocks 


Nij P 切 ] 


and Pij is the companion matrix of 7ry ( 入 ) and has the form 
(10). The matrix thus obtained will be called a classical canonical 
matrix of A. It displays the prime factors 7ry(X) and the expo¬ 
nents of these primes in the factorization of the ( 入 ) • The ideals 
will be called the elementary divisor ideals of A. Also 
the polynomials 7r t y ( 入 ) will be called the elementary divisors of 
(a) = Xl — (a). 

For example, suppose that the invariant factors ^ 1 ofXl — (a) 
are X 3 ■- 入 2 — 入 + 1 = ( 入一 1 ) 2 (入 + 1) and 入 6 — 3 入 4 + 3 入 2 — 1 
= ( 入一 1 ) 3 (入 + I) 3 . Then the Jordan canonical matrix is 


To illustrate the method of obtaining the canonical matrices ， 
let A be the linear transformation such that 

6 \A — — 6 \ 一 2^2 + 6^3 

62 A = 一 e\ + 3^3 
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0 

1 

0 







0 

0 

1 







一 1 

1 

1 










0 

1 

0 

0 

0 

0 




0 

0 

1 

0 

0 

0 




0 

0 

0 

1 

0 

0 




0 

0 

0 

0 

1 

0 




0 

0 

0 

0 

0 

1 




1 

0 

-3 

0 

3 

0 


The elementary divisors here are (X — l) 2 ，(X + 1)，(X —- l) 3 , 
(入 + l) 3 . Hence a classical canonical matrix is 


一 1 

0 

0 

1 

一 1 

0 

0 

1 

—1 


001 

ii IX 

IX IX 



e^A = —ei — e2 + 4 ^ 3 . 
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1 



0 1 

一 1 2 


0 1 

0 


1 

3 一 3 + 入- 

0 —1 

1 

[入 1 一 （ a)] 

0 

0 一 1 

-1 一入 + 2 

一 3 - 


-0 

1 — 1 


0 入 


Thus 


0 


0 (X —" 1) 


2 


and 



1 3 一3+入- 


1 X 一3, 

( M ) = 

0 0 一 1 

， ( m )- 1 = 

0 -1 1 


-0 1-1 . 


.0 一 1 0. 

ei 

=+ X ^ 2 ~~ 3 e 

3 = ei + e 2 A 

一 3^3 = 0 

e 2 r 

= — e 2 + e z 



e 3 ’ 

= — e 2 . 




To obtain the Jordan matrix we use the basis/i = W 2 
fz = A = ei — 3<? 3 . Hence the Jordan matrix is 


G ’， 


The matrix (a) here is 


-1 

-2 

6' 


*x + 1 

2 

— 6 

一 1 

0 

3 

and 入1 — (a)= 

1 

入 

一 3 

广 1 

-1 

4 - 


^ 1 

1 

入一 4 - 


We have 


The matrix that transforms (a) to this matrix is the matrix of 
(/i ， / 2 ， / 3 ) relative to e 2y e 3 ) and this matrix is 

0 -1 r 

0-1 0 • 


We can check that 


*0 

一 1 

r 


一 1 

一 2 

6' 


0 

一1 

r 

—1 

"1 

0 

0 

0 

一 1 

0 


—i 

0 

3 


0 

一 1 

0 

一 

0 

0 

1 

•1 

0 

一 3 - 


•— 1 

-1 

4. 


.1 

0 

一 3 - 


.0 

一1 

2. 


00 


ix 
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We consider now the classical canonical matrices for the case 
where 中 is the field of complex numbers ， or，more generally, any 
algebraically closed field.* Here the only irreducible polynomials 
of positive degree are the linear ones. Hence the elementary di¬ 
visors have the form (X ― p) k . The block (C" in (28)) corre¬ 
sponding to this elementary divisor is 


(29) 


广 、飞 

P 

1 P 

• • - k. 



PJ 


The classical canonical form has blocks of this type strung down 
the main diagonal. 

Suppose next that 伞 is the field of real numbers. In this 
case the irreducible polynomials of positive degree are the linear 
ones and the quadratic ones 入 2 — 卢入一 7 where P 2 + 4y < 0. 
The elementary divisors are of the forms (X ― p) k y (X 2 一 入一 y) k . 
The block corresponding to (X — p) k is (29) and that correspond¬ 
ing to (X 2 一 jSX 一 y) k is 


(30) 


0 1 

7 3 


0 0 

1 0 

0 1 

7 P 


0 

0 

0 

1 

1 

0 

7 



k blocks. 


* A field is said to be algebraically closed if every polynomial with coefficients in the 
field has a root in the field. An equivalent definition is that every polynomial with co¬ 
efficients in the field factors into linear factors. 
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and find a matrix that transforms this matrix into the canonical matrix. 

2. Prove the following theorem : 

A necessary and sufficient condition that two matrices (a) and (/3) in be similar 
is that XI — (a) 入 1 — ( 尽 ) have the same invariant factors in $[X] n . 

3. Prove that any matrix is similar to its transposed. 

4. Given the following elementary divisors: (X — l) 3 , (X — 1), (X 2 + l) 4 , 
(X 2 + l) 2 , (X 2 + 1), (X + 2), what are the invariant factors? 

5. Prove that if / is any vector whose order is the minimum polynomial of A 、 

then there exists an invariant subspace @ ^ ©) such that 9? : ={/}©©• 

6. Let © be an invariant subspace such that the invariant factors of the trans¬ 
formations induced by yf in @ and in 9?/@ together give all the invariant fac¬ 
tors of A. Prove that there exists a second invariant subspace U such that 

9? = © ㊉ U. 

12. The characteristic and minimum polynomials. Again let 
= {/i} ㊉ {A} ㊉…㊉ {/4 where the order ideals of the fi 
are the invariant factor ideals (5^). Thus the order of fi is 
and di I dj if i < j. We know that the minimum polynomial 
of / is the least common multiple of the orders of the gen¬ 
erators fi ， By the divisibility conditions this l.c.m. is 
Hence /x(X) = d t (K). 

Now let (a) be any matrix of A. We know that, if A n (X)= 
det (入 1 — (a)) and A n _x(X) is the highest common factor of the 
{n — 1)-rowed minors of XI — （ a：)，then the following relations 
hold 

(31) A n (X) = 5!(X)5 2 (X) • • - d t (X) 

(32) M(>0 = 心 (X) = A n (X)[A n _ 1 (X)]~ 1 . 

The polynomial A n (X) is called the characteristic polynomial of (a) 
(or of A). If we refer to (23) we can see that 

(33) A n (X) = X n — ai\ n—1 + «2^ n ~ 2 • • . + ( — l) n «n 

where ai is the sum of the diagonal minors of order i in (a). 


EXERCISES 

1. Find a classical canonical matrix similar to 


1441-4 


2 5 4 2 
13 I 

1 1 I 


22 


6 2 4 
4 1 





_THE THEORY OF A SINGLE LINEAR TRANSFORMATION 99 

Of particular importance are the first and last as. These are 

(34) ai = an + «22 + * • •+ 0 L nny a n = det (a). 

The former is called the trace of (a). The main properties of this 
function of (a) will be considered in § 14. 

Now we know that, if p ( 入 ） is any polynomial such that v(A) 
= 0， then v((a)) = 0. Also if ju(X) is the minimum polynomial 
of then /x(X) is the minimum polynomial of (a). Hence our 
results may be stated as the following theorem on matrices. 

Theorem 13. Let (a) be a matrix in and let A n (X) = det (XI — 
(a)) and /x(X) = A n (X) [A n _i(X)] _1 where A n _i(X) is the highest 
common factor of the (n — \)-rowed minors of — (a). Then 1) 
A n ((a)) = ju((a：)) = 0; 2) if v(\) is any polynomial such that 
p((a)) = 0, then m(X) | ^(X); 3) /x(X) and A n (X) have the same prime 
factors. 

The first two statements are clear from what we have proved 
about A. The last statement follows from (31) and the fact that 
all the Si(X) are factors of d t (\) = m ( 入 ). 

Theorem 13 is a composite of the theorem of Hamilton-Cayley 
on the characteristic polynomial and Frobenius’ theorem on the 
minimum polynomial. Direct matrix proofs of these results will 
be given in the next section. 

EXERCISES 

L Prove that A is cyclic if and only if XI — (a) has only one invariant factor 

7^ 1. 

2. Prove that, if (a) is nilpotent, then the invariant factors of* 入 1 — (a) all have 
the form Hence prove that any nilpotent matrix is similar to a matrix of 
the form 



where Ni has the form 
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3. Prove that a matrix with elements in the field of complex numbers is simi¬ 
lar to a diagonal matrix if and only if its minimum polynomial has no multiple 
roots. 

4. Show that, if (a) is idempotent, then the elementary divisors of 入 1 一 (a) 
are either X or 入 一 1. Use this to prove the result on p. 62 for the case A a 
field. 

5. Show that, if « is a vector 〆 0 such that uA — pu y then p is a root of the 
characteristic polynomial. Conversely, show that, if p is a root belonging to $ 
of the characteristic polynomial, then there exists a vector « 〆 0 such that uA 
— pu. 

6. A vector u ^ 0 such that uA = pu is called a characteristic vector of A. 
Prove that such vectors always exist if is an algebraically closed field. Prove 
also that, if <!> is the field of real numbers, then any linear transformation in an 
odd dimensional space over $ possesses characteristic vectors. 

13. Direct proof of Theorem 13. From the point of view of 
matrix theory the proof that we have given of Theorem 13 is 
somewhat roundabout. In this section we shall generalize the 
results contained in this theorem, and we shall give direct proofs 
of these results. We suppose first that o is any commutative 
ring with an identity. Let o[X] be the polynomial ring in the in- 
determinate 入 and consider the matrix ring o[X] n . This ring con¬ 
tains the subring o n of matrices with elements in o. Also it con¬ 
tains the matrix 

XI = diag { 入， X ， • • . X} 

which evidently belongs to the center. Now the essential ob¬ 
servation for our purposes is that o[X] n = o n [Xl] and XI is tran¬ 
scendental relative to o n . To see this，let (a(X)) be an arbitrary 
matrix in o[X] n and write 

(35) a"(X) = aijo + + . • • • 

Then if we recall that the product (a)Xl is obtained by multiplying 
all of the elements of (a) by 入， we see that 

(36) ( a (入 )） = ( 戊 ) o + (o:)i\l + (a) 2 (Xl) 2 + • . • 

where (a) k is the matrix that has aijk in its (/, j) position. Next 
suppose that (a) 0 + (a)iXl + (a) 2 (Xl) 2 +•••=()• Then the 
(/, j) element of the left-hand side is given by (35). Since this 
element is 0, a^k = 0. Hence every (a) k = 0, and this proves 
the transcendency of 入 1 relative to o n . 
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If 

</>(X) = /^o + ^ 1 ^ + 卢 2 入 2 + . • • 

is a polynomial in o[X], then by </>((a)) we shall understand as usual 
the matrix 

卢 0 1 + ^i(a) + 卢 2 (a ) 2 + • • • 

where in general Pi(y) is obtained by multiplying all the elements 
of ( 7 ) by Thus 0 ((a)) is obtained by replacing XI by (a) in 
0(X)1 = I3 0 l + ^(Xl) + 知 (\1) 2 +•••• 

If (a) 8 o n we define the characteristic polynomial A n (\) to be 
the polynomial det (入 1 — (a)) belonging to o[X]. We shall now 
prove the following 

Theorem 14. (Hamilton-Cayley) If (a) e o n ^ 0 a commutative 
ring with an identity, and Aw ( 入 ) is the characteristic polynomial, 
then A n ((a)) = 0. 

Proof. We recall the identity (Vol. I ， p. 59) 

(37) [XI — (a)] adj [XI — (a)] = det (XI — (a))l = A n (X)l. 

The matrix adj [XI — (a)] e o[X] n = 0 n[Xl]，and the degrees of its 
elements are <n — 1 . Hence 

adj [XI — (a)]= ⑻ o( 入 l ) 71 一 1 + (^)i(Xl ) n ~ 2 + •••+ 

Also if A n (X) = X n — aiX n—1 + • • • + ( —l) n a n ，then 

A n (X)l = oa) w - ai(Xl)— 1 + ..• + (- 1)W. 

Hence the identity (37) is equivalent to 

(38) [XI — (»)] [ ⑻ o(Xl ) 71 - 1 + (/3)i(Xl ) n-2 + • • • + (/3) n _i] 

=(Xl) n - ^(Xl )"- 1 + ••• + (-l) n a n l. 

Thus we see that XI — (a) is a factor of A n (X)l in o n [Xl]. By 
the factor theorem (Volume I, p. 99) this implies that 

(a) n - a x {a) n ~ l H - h (-l) n a n l = 0 

as required. 

We suppose next that 0 is a Gaussian integral domain，that is, 
a commutative integral domain with an identity in which the 
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unique factorization theorem holds. For such domains we have 
the following 

Theorem 15. (Frobenius) Let (a) eo ny o a Gaussian domain) 
and let A n (X) = det (XI — (a)) and jLt(X) = A n (X)[^(X)] —1 where 
^(X) is the highest common factor of the {n — \)-rowed minors of W 
—(a). Then 1) ijl((o)) = 0, 2) if v(\) e o[X] and v((a)) = 0, then 
ju(X) I v{X) in o[X], 3) any irreducible factor of A n (X) is a factor of 
m(X). 

Proof. The existence of 沒 (X) is assured by the fact that o[X] is 
a Gaussian domain. Since some of the (n — l)-rowed minors 
(e.g., the diagonal minors) have leading coefficient 1， we may 
suppose that 沒 ( 入 ） has leading coefficient 1. Clearly 沒 ( 入 ） is a fac¬ 
tor of △/!( 入 ) since it is a factor of all the {n — l)-rowed minors. 
The quotient ju(X) has leading coefficient 1. Now let Oy ( 入 ) ） de¬ 
note the matrix in o[X] n that is obtained by dividing out the ele¬ 
ments of adj [XI — (a)] by 6 (\). Then by (37) we have 

(39) [XI ~ (a)](7(X)) = M(X)1. 

By the argument used in the preceding proof，this relation im¬ 
plies that 〆(《)) = 0. This proves 1). 

Now let /x*(X) be a polynomial 〆 0 of least degree such that 
: 0. We may assume that ju*(X) is primitive. Suppose 
that v(X) is any polynomial such that v((a)) = 0. If P is the 
quotient field of o, we may write 

K 入） = ^(X)/x*(X) + r(\) 

in P[X] where deg r(X) < deg Multiplication by a suitable 

element 77 〆 0 in o gives a relation 

” K 入） = 《 i( 入 ) M* ( 入） + 广 1( 入） 

where ^i(X)= 啊 ( 入 ） and ”i(X) = nK 入） eo[X]. Substitution of (a) 
in this relation gives ri((a)) = 0. Hence by assumption of mini¬ 
mality for the degree of /x*(X) > ri(X) = 0. Thus m*(X) | 入 ) • 
Since /x* ( 入 ) is primitive, m* ( 入 )| ^(X). In particular, m* ( 入 )| M(X )， 
and so, since the leading coefficient of ju(X) is 1， we may suppose 
that /x* ( 入 ） has this property too. 
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We now write /x(X) = jit*(X)p(X). Since ju*((a)) = 0, by re¬ 
versing the argument used to prove 1)，we see that 

M*(X)1 = [XI — (a)](5(X)) 

where (6(X)) e o[X] n . Hence 

A n (X)l = M *(X)p(X)^(X)l = [XI - (a)](5(X))p(X)0(X)l. 

If we compare this with (37) and use the fact that 入 1 — (a) is 
not a zero-divisor * in o[X] n , we obtain 

adj [XI — (a)] = (5(X))p(X)0(X)l. 

Thus all the {n — 1)-rowed minors of 入 1 一 (a) are divisible by 
p(X)d(X). Since 沒 ( 入） was assumed to be the highest common fac¬ 
tor of the {n — 1)-rowed minors, it follows that p(X) = 1. Thus 
M ( 入 ） = - m*( 入 ). Statement 2) now follows from what we proved 
above. 

To prove 3) we take the determinants of both sides of (39). 
This gives 

A n (X) det (y(X)) = [mOO]' 

Statement 3) is an immediate consequence. 

EXERCISE 

1. Show that the characteristic and minimum polynomials of 


Oio 

Oil 

«2 

OiZ 

Oil 

OiO 

—a s 

«2 

Oi2 


«o 

—a\ 

«3 

— CX2 

Oil 

ao 


are, respectively, 

(X 2 — 2aoX + (ao 2 + «i 2 + « 2 2 + «3 2 )) 2 

and 

X 2 — 2aoX + (ao 2 + «i 2 + «2 2 + « 3 2 ). 

14. Formal properties of the trace and the characteristic poly¬ 
nomial. We have defined the trace of (a), tr (a) y to be the nega- 

* Its determinant is A n [X] ^ 0. 
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tive of the coefficient of X n_1 in the characteristic polynomial of 
(a). From this it follows that 

(40) tr (a) = an + a 2 2 + * * * + oi nn . 

If the characteristic polynomial ( 入） =n(X — pi) in some ex¬ 
tension field, then the are called the characteristic roots of (a) 
in this field. The coefficients of D) are the so-called elementary 
symmetric functions of the In particular 

(41) tr (a) = Pl + P 2 + P 3 + * * * + Pn« 

From (40) it is clear that the trace function is linear: 

(42) tr [(a) + (13)] = tr (a) + tr (/3). 

tr (p(a)) = ptr (a). 

We can also verify the following property 

(43) tr (a)(0) = tr ⑹ (a). 

For the (/, i) element of (a)(0) is Hence 

i 

tr (a) (/3) = X 

ij 

and this is symmetric in (a) and ⑹ • 

The result we have just noted holds also for the other coeffi¬ 
cients of the characteristic polynomial. Thus (a) (/3) and (jS) (a) 
have the same characteristic polynomials. This, too, can be 
verified directly. However, the following indirect proof has some 
elements of interest of its own. 

We shall suppose more generally that (a) is an m X n matrix 
and ⑻ an n X m matrix with elements in a field. Then multi¬ 
plication in either order is possible, and the resulting matrices 
(a) (/3) and (jS) (a) are respectively m X m and n X n matrices. 
Assuming that n > m y we shall show that the characteristic 
polynomial of (13) (a) = 入 times the characteristic polynomial 
of (a) (13 ). We assume first that (a) has the following form 

• —— r —— , 

(44) (a) = diag {1，• • • ， 1 ， 0 ， … ， 0} 
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Then if 


⑹ = 


3ll Pl2 

^21 ^22 

• • 

L 卢 nl 卢 n 2 


3 lm 

^2m 



73n 

012 

… Plm' 

⑷⑹ = 

Pn 

Pr2 

* 3 rm 


0 

0 

… 0 


• 

-0 

• 

0 

• • • • 

… 0 . 


⑻ （ a )= 



… Plr 

0 

… 0 

卢 21 

參 

…卢 2 r 

參參參 • 

0 

• 

... 0 

♦ 春參 • 

參 

• • • • 

* 3 nr 

• 

0 

• •參 參 

• • • 0- 


Hence if 兄 ( 入 ） denotes the characteristic polynomial of 

3ii P 12 • . • Pii 


L 卢 rl 卢 r 2 • • • 卢"」 

then the characteristic polynomials of (a) (P) and of (/5) (a) are 
respectively X m-r ^*(X) and 入竹一？ ( 入 ) .This proves our assertion. 

We suppose now that (a) is arbitrary. There exists a matrix 
(/i) in L(^ y m) and a matrix {v) in L(^>, n) such that (m) (a) (p) 
=(a)i has the form (44). Set = d. Then by 

what we have just proved, the characteristic polynomial of 
(/3)i(a)i is \ n ~ m times that of (a) 1 (^) 1 . On the other hand, 

0)i ⑹ 1 = (m)O)0)0) - 1 ⑹ (M)— 1 = ㈤ ⑹⑹ ㈤― 1 
is similar to (a ) ⑹ and 

⑻ 1 W 1 = 0)— ⑽㈤ 一 HWWO) = W _1 (/5)(«)W 
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is similar to ⑹ (a). Hence (a)(/5) and (a)i(/3)i have the same 
characteristic polynomials, and ⑹ (a：) and have the same 

characteristic polynomials. The asserted result therefore holds 
for (a) ((3) and This proves the following 

Theorem 16. Let (a) be an m Y, n matrix and ⑻ an n X m 
matrix with elements in a field. Then if n > the characteris¬ 
tic polynomial of {0){a) is \ n ~ m times the characteristic polyno¬ 
mial of (a) ⑻ • 

EXERCISE 

1. (Flanders) Show that the elementary divisors not divisible by 入 of (a) (/3) 
and (/3)(a) are the same. Also obtain a relation for the elementary divisors 
which are powers of X. 

15. The ring of o-endomorphisms of a cyclic o-module. In 

the remainder of this chapter we shall consider the problem of 
determining the linear transformations that commute with a 
given linear transformation and the generalization of this prob¬ 
lem to modules. 

If yf is a linear transformation in 9? over 中 ， the totality 33 of 
linear transformations that commute with ^ is a subalgebra of 
2. If 5 e 33， then a\B = Bai and AB = BA. Hence B com¬ 
mutes with every linear transformation p 0 i + + ^ 2 i^ 2 + • • • 

belonging to the subalgebra 21 = ^i[A] generated by 1 and A. 
Conversely, if B is any endomorphism in the group 沉 that com¬ 
mutes with every element in 21， then B eS3; for aiB = Bai for 
all a so that 5 is a linear transformation and BA = AB. 

If 況 is regarded as a ^>[X]-module as before，then 

x(^oi + 3 lid +•••)= <t>(K)x 

where 含 ( 入） =i^o + i^i 入 + • • • • Hence，an endomorphism B com¬ 
mutes with every linear transformation belonging to 21 if and 
only if ― 0(X) (xB). Hence S3 coincides with the set of 

$[X]-endomorphisms of 沉 . We are therefore led again to adopt 
the module point of view，and to consider the problem of deter¬ 
mining the set 33 of o-endomorphisms of any finitely generated 
o-module, o a principal ideal domain. It is evident that S is a 
subring of the ring of endomorphisms of the group 況 . 
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As usual we denote the ring of the endomorphisms ai： x ax y 
a in o, by o；. This ring is a homomorphic image of o and so it is 
commutative. It follows that 0z ^ S3 the ring of o-endomor- 
phisms. It is also clear that Oi is contained in the center of 33. 
It should be remarked that in the special case of the $[X]-module 
determined by a linear transformation A 、the ring ^[K]i is just 
the ring 21 = 

We consider first the problem of determining S3 in the special 
case of a cyclic o-module. It is not necessary to assume here 
that o is a principal ideal domain，but only that o is a commuta¬ 
tive ring with an identity. We have the following 

Theorem 17. If o is a commutative ring with an identity and 

is a cyclic o-module y then the only ^-endomorphisms of dt are the 
mappings x —> ax. 

Proof. Let 9? = {e} and let B be an o-endomorphism of 9?. 
Suppose that eB = ^e. Then if ^ = ae y xB = (ae)B = a{eB) 
— ^(ae) = Thus B = pi. 

Corollary. If A is a cyclic linear transformation in a vector 
space over a field，the only linear transformations that commute with 
A are the polynomials in A {with coefficients in 电 i). 

EXERCISE 

1. Show that the matrices that commute with 



are given by 



where the are arbitrary in 
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16. Determination of the ring of o-endomorphisms of a finitely 
generated o-module, o principal. We suppose now that 5 R is a 
finitely generated o-module, o a principal ideal domain. We know 
that 9 ? = {/i} ㊉ {A} ㊉ •••©{/} where, if the order ideal Q fi 
= ⑹，/ = 1 ， 2 ， •••，/, then 

(45) 8 j = 0 if j > u and 8 ^ | 8 j if i < j for all i y j. 

Let 5 e 33 the ring of o-endomorphisms of and suppose that 
fiB = i = 1 , 2 y • • •, /. Then if x is any element of SR, ^ = 
2^/i, in o. Hence 

= 2 如. 

Thus B is completely determined by its effect on the generators 
ji of dt. We note next that since bifi = 0 , digi = = 

= 0. Hence if (ej is the order ideal of g iy then e t - | 
Conversely, suppose that for each i y gi is an element of 
whose order ideal (e z -) satisfies the condition u | 8 {. Define B to 
be the mapping Then we assert that .5 e S 3 . We 

show first that B is single-valued. For suppose that 
are two representations of the same element. Then 2 ( 匕一 y] t ) fi 
= 0 . Hence bi | (^ — rji). Consequently u | — w)，and this 

implies that 2 ( 匕 一 rji)gi = 0 , or 2 ^g\- = This shows that 

the results obtained from the two representations are equal. 
The verification that B is an o-endomorphism is now immediate. 

Our result is the following : There is a 1-1 correspondence be¬ 
tween the elements B e^8 and the ordered sets g 2y • • • ， gt) of 
elements gi whose order ideals (e t -) satisfy the condition e t - | 

We now set gi = fty e o, and we associate with the ordered 

set (足 1 ，文 2 , - 'ygt) the matrix 

Pll 3l2 • • • 3lt 

尽 21 ^22 • • • 

♦ • • • • • 

Ptl Pt2 ••• Pit 

in the ring of / X / matrices with elements in o. This matrix 
is not uniquely determined. For any fty may be replaced by a 
(3i/ such that 3i/ 三 ^ij(mod 6 y). This is the only alteration that 


(46) ⑹ = 
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can be made without changing the g{. Hence we may say that 
the elements of the j-t\v column of (0) are determined modulo 5y. 
The condition e» | di y or what is the same thing ， Sigi = 0, is 
equivalent to the equations 

(47) bSij = 0 (mod dj). 

This, of course，means that there exist yij such that 5 ^/ 5 ^ = 
Hence (47) is equivalent to the following condition on the matrix 
(/5) of (46). There exists a matrix ( 7 ) such that 


(48) 


d 


^2 


^11 

012 

… 

P 21 

^22 

… & 2t 

3tl 

&t2 

• • • 


7u 

712 

… 7u 

721 

• 

722 

• 

… 721 

• • • • 

7n 

7(2 

… ytu 


8 


5 2 


The totality of matrices (/3) which satisfy this condition is a 
subring of the matrix ring o t . The matrix (fi) determines an ele¬ 
ment 5 of 33 such that fiB = It is easy to verify that the 

correspondence ⑹— ^ is a homomorphism between 9 W and S 3 . 
Now the endomorphism B determined by (/3) is 0 if and only if 
Pij = 0 (mod 5y). Hence the kernel of our homomorphism is the 
set 汧 of matrices {v) in which 〜 is a multiple Thus B 

if and only if there exists a (m) in o t such that 


(49) W = ( m )(5) 

where (5) = diag {5i, 5 2 , • • S 山 The ring S 3 is isomorphic to 
the difference ring 9 W/ 5 W. 

Theorem 18. Let dt = {/ 1 } ㊉{/ 之 }㊉ •••©{/<} where the 
order ideal of fi is (5^). Then the ring S3 of o-endomorphisms of 9? 
is isomorphic to the difference ring 9K/92 where Tl is the subring of 
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o t of matrices (/5) for which a (y) exists such that (48) holds and 
is the ideal of matrices (v) for which a (ju) exists such that (49) holds• 


An explicit determination of the matrices of 3D? can be made if 
use is made of the conditions (45) on the 5’s. We note the fol¬ 
lowing cases of (47): 

1. / > j. Here hi = 0(mod b 3 ). Hence these Pij are arbitrary. 

2. i < u y j > u. Here (47) and (45) imply that these j% = 0. 

3. i^j > u. Here hi = dj = 0 and the jS’s are arbitrary. 

4. i < j < u. Let rjij = Then (47) is equivalent to 

the condition Pij = 0(mod ??")• 

Thus (0) has the following form: 


(50) 


^11 

戸 12 

… Plu 


^21 

• 

尽 22 

• 

* ^2u 

• • • • 

0 

3ul 

3u2 

• • • 3uu 


• 

戸 w + l，2 

• 

* 戸 w + l，w 

• • • • 

^u~\-l f u-\-l • • • + 

争 • • • • 

• 

• 

Pt2 

參參鲁 • 

… Ptu 

• • • • • 

ft，w + l . . • 3tt 


where all the 0’s are arbitrary except above the main diagonal in 
the upper left-hand block. Here 13“ = Mo.Wy where 叫 is arbi¬ 
trary and rjij = di—'dj. The condition 〜 三 0(mod dj) for these 
/3’s is equivalent to My 三 0(mod 

17. The linear transformations which commute with a given 
linear transformation. We specialize dt to be the 伞 [ 入 ] -module 
determined by the linear transformation A. Here every hi ^ 0 
so that u = t. The ring 9JJ now consists of all the matrices (/3) 
in which the fty are arbitrary if i > j and fty = 叫陶，叫 = 
for i < j. Any 3ij may be replaced by pi/ in the same coset 
(mod 8j). Consequently may be replaced by jii/ in the same 
coset (mod di). Thus if rii = deg di then we may suppose that 

deg < rij if i >j 

deg fiij < rii if i <j. 
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A matrix in 9 K that satisfies these conditions will be called a 
normalized matrix. It is clear that two normalized matrices de¬ 
termine the same B in the ring S 3 of o-endomorphisms if and only 
if they are identical. Hence the correspondence ⑹ —> B deter¬ 
mined before is 1-1 between the set U of normalized matrices and 
the ring S3. 

We know that S3 3 21 = ^i[A] 3 It follows that 33 is a 
subspace of the vector space ? over We wish now to compute 
the dimensionality of S3 over 

We note first that the normalized matrix corresponding to the 
scalar multiplication ai is the scalar matrix a\ = diag {a y a y • • •， 
a} of t rows and columns ； for we have the relations jiai = afi ， 
Also it is clear that the set U of normalized matrices is closed 
under addition and under multiplication by scalar matrices. It 
follows that U may be regarded as a vector space over 中 . Here 
a ⑹ for ( 0 ) in U is defined to be the matrix cel( 々 ). If i = 1 , 2 , 
is in 33 and Bi Q3i) eU, then clearly Bi + B 2 (^i) + (/5 2 ) 
and aBi — a(/3i). Since our correspondence is 1-1，this shows 
that S 3 over $ is equivalent to U over We now determine the 
dimensionality of U. 

Let Mij denote the subspace of U of normalized matrices in 
which Pki — 0 for all ( 々 ，/) 〆 It is easy to see that if 
i >j y dim Uijy the dimensionality of the space of polynomials of 
degree < nj is nj. Similarly if i < j y dim U^- = rii. Since U is a 
direct sum of the subspaces U "， 

t t 一 1 

dim U = 2 (， 一 i + 1 ) 〜 + X - i)rii 

j = l i = l 

=I ： ( 2 / ~ 2 j + l)nj. 

This proves the following 

Theorem 19. {Frobenius) Let (a) e^ n and let 5i(X), 5 2 (X), • • •， 
S t (X) be the invariant factors 〆 1 XI — (a). Then if the degree 
of di(X) is the maximum number of linearly independent matrices 
commutative with (a) is given by the formula 

TV = I ： (2/ - 2 j + l)nj. 
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Pl2 ' 

" 22 ’ 

022 + 2022 - 


t 

Clearly, if / > 1， then N > ^2 nj = n > n t . Since the dimen- 

j = 1 

sionality of 51 = ^i[A] over is n ty this shows that, in this case ， 
33 3 21. If we recall that / = 1 is the condition that A be cyclic, 
we obtain the following converse of the corollary to Theorem 17. 

Corollary. If A is a linear transformation which is not cyclic, 
then there exist linear transformations that commute with A which 
are not polynomials in A. 

Example. Let r ^ 0 Ch 

(a) = 0 0 1. 

.0 — 1 2 - 

Here, if A is the corresponding linear transformation, then St = !/i} © {J2} • 
The invariant factors are 5 i = 入 一 1 and 62 =( 入一 l) 2 . The general form of a 
normalized matrix ( 3 ) is 

■/ 3 n M 入 一 1) L 
-^21 ^22 + / 522 ； X- 

Since X/i =/i and X 2 / 2 = ( 2 X - l)/ 2 = -/ 2 + 2( 入/ 2 )， 

flB = ^ll/l —卢 12/2 + 卢 12( 入 /2) 

J2B = ftl/l + 卢 22/2 + 爲 22 ’ 0 sf^) 

( 入 / 2)5 = 02 l/l — ^ 22^2 + (/?22 + 故 22 ')( 入 / 2 ) • 

It follows that the general form of a matrix commutative with (a:) is 


EXERCISES 

1. Let 5R be a finite commutative group and suppose that 0? is a direct sum of 
cyclic groups of orders wi, « 2 > …，… where ni | rij for i < j. Prove that the num¬ 
ber of elements in the ring of endomorphisms of 9? is 

# = n n^- 2i+ \ 

7=1 

2. Determine the matrices that commute with 

-0 0 0 0 0 ' 

1 0 0 0 0 

0 0 0 0 0 . 

0 0 10 0 
.0 0 0 1 0 . 


fi 

12 2 
op ^0- op 


12 2 
op op 
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3. Determine the matrices which commute with 

-10 0 Oi 

0 0 10 
0 0 0 1 
-0 1 — 3 3. 

18. The center of the ring 33. We return to the general case 
where 況 is a finitely generated o-module, o a principal ideal do¬ 
main. As before，let 況 = = {/i} ㊉ {A} ㊉…㊉{ 力 } where the 
orders (8i) satisfy (45). We shall prove the following 

Theorem 20. The center of the ring of Q-endomorphisms of 9? 
consists of the scalar multiplications. 

Let S3 be the ring of o-endomorphisms, E its center and the 
ring of scalar multiplications x — > ax. We have seen that 0 i C S. 
Now let C be any element of S. Let k = 1 ， 2， •••，/，be the 
o-endomorphism such that fjEk = Sjkfkyj = 1 ， 2， •••，/• By the 
considerations of section 16， such endomorphisms exist in S3. 
Also there exists o-endomorphisms E t k such that fjE t k = Sjtfk- 
Since C commutes with these endomorphisms，we have the fol¬ 
lowing equations 

ftC = {f t E t )C = (ftC)Et = y/ h yea 

fkC = (f t E t k)C = {f t C)E t k = {y ft) Etk = y(ftE t k) = y/k- 

Thus C coincides with the mapping x —> yx. Hence @ = o；. 

If C is any endomorphism in dt commuting with every element 
of 93, then, in particular, C commutes with every element of o^. 
Hence C e 93. Thus C is in the center of S3. The converse is 
clear. This remark enables us to state Theorem 20 in the follow¬ 
ing alternative form: 

Theorem 20 \ The only endomorphisms of 9? which commute 
with every ^-endomorphism are the scalar multiplications. 

This specializes to the 

Corollary 1. If C is a linear transformation that commutes with 
every linear transformation which commutes with A, then C is a 
polynomial in A. 

This corollary enables us to determine the center of the com¬ 
plete ring 2 of linear transformations. For let ^ = 1. Then the 
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ring 33 of linear transformations that commute with A is the com¬ 
plete ring S. Hence Corollary 1 states that the only linear trans¬ 
formations that commute with every linear transformation are 
the polynomials in 1. Since a linear transformation is expressible 
as a polynomial in 1 if and only if it is a scalar multiplication, 
this gives the important 

Corollary 2. The center of the ring of linear transformations of 
a vector space over a field ^ is the set 龟 i oj scalar multiplications. 

A slightly more direct proof of this result will be given later 
(Chapter VIII ， p. 229). 

EXERCISES 

1. Prove that the center of the ring of endomorphisms of a finite group con¬ 
sists of the endomorphisms x — mx、m an integer. 

2. Prove that a linear transformation A is cyclic if and only if the ring 33 of 
linear transformations commutative with A is commutative. 

3. Prove the following extension of Theorem 20 ’： The only endomorphisms of 
9? which commute with every idempotent O-endomorphism are the scalar mul¬ 
tiplications. 
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In this chapter we shall introduce some general concepts which 
are fundamental in the study of arbitrary sets of linear transfor¬ 
mations. A deeper study of these notions belongs more properly 
to the so-called theory of representations of rings and is beyond 
the scope of the present volume. An introduction to these notions 
will serve to put into better perspective the results of the pre¬ 
ceding chapter. We shall also be able to extend some of these 
results to sets of commutative linear transformations. 

1. Invariant subspaces. For the most part we shall be concerned 
in this chapter with the general case of a vector space over a 
division ring A. Let 況 be a finite dimensional vector space over 
A and let be a set of linear transformations in 9? over A. If 
{e u e 2y •• • • ， e n ) is a basis for dt and yf e 0, then eiA = and 

(a) is the matrix of A relative to the given basis. The matrices 
(a) determined in this way by the A constitute a set co that 
we shall call the set of matrices of 0 relative to {e u e 2y … ， e n ). If 
C/i ， / 2 ，• • 'yfn) is a second basis and fi = then the matrices 

of 0 relative to this new basis is the set { (fx) (a) (/x) _1 }, (a) in co. 
We denote this set as (/x)w(ju) 一 1 . 

From the geometric point of view a fundamental problem in 
the study of a set of linear transformations is that of determining 
the invariant subspaces relative to this set. As in the case of a 
single linear transformation a subspace © is called invariant under 
12 if Q © for every A If 12 consists of a single transfor¬ 
mation A 、then the cyclic subspaces are examples of invariant 
subspaces. Other simple examples are the following: 

1. 12 consists of the linear transformation 0. Here any sub¬ 
space is invariant since ©0 = 0 C © for any ©. 
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2. 12 = ? the complete set of linear transformations. Here the 
only invariant subspaces are the zero space 0 and the whole 
space 9?. Thus let © be an invariant subspace 〆 0 and let y 
be a non-zero vector in Then if x is any vector in 9 ?， there 
exists a linear transformation A such that yA = at. Since 0 is 
invariant x = yA e ^>A C Hence x and since is arbi¬ 
trary © = 9?. 

Obviously the whole space is an invariant subspace relative 
to any set Also the 0 space is invariant since 0^ = 0 for any 
linear transformation A. The second example above shows that 
there exist sets 12 for which these two “trivial” subspaces are the 
only invariant subspaces. Such a set is called an irreducible set. 
It is also convenient at times to say that dt is irreducible relative 
to the set 0. 

Reducibility, or the existence of a proper (〆 0 ， 〆 況 ） invariant 
subspace manifests itself as a simple condition on the sets of 
matrices of 12. Suppose @ is a proper invariant subspace and let 
(/i ， / 2 , • • • ， / n) be a basis for 9? such that (/i，/ 2 , . • •，/ r ) is a basis 
for ©• Since © is invariant ， fiA e @ for each / = 1 ， 2 ， . . r 
and each A Hence the relations that give the matrix A 
relative to CA ， / 2 , … ， /n) are 

r 

JiA = s Pijfjy i = 1, 2, …， r 

⑴ 卜 1 

n 

2 Pkifi ，々 = r+ l ， r+2 ， 

1 = 1 


Hence the matrix ((3) of A has the form 


⑺ 



戸 12 

...Plr 

0 

0 

•••0 

021 

• 

& 22 

… 卢 2r 

0 

0 

… 0 

3rl 

Pr2 

.• • 3rr 

0 

• 

0 

• • « • 

… 0 

3r + l，l 

• 

Pr + 1，2 

• 

* 3r + l，r 

• • • • 

0r + l,r + l 

• 

• 

• 

• • • 3r + l，n 

• • • • 

• 

Al 

參 

Pn2 

• • • « 

^nr 

• 

Pn，r + 1 

• 

• 

• • • • 

• • • 3n，n - 
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A matrix that has an r X n — r block of 0’s in its upper right- 
hand corner is said to have reduced form. Hence the existence of 
a proper invariant subspace implies the existence of a basis rela¬ 
tive to which the matrices of 0 all have reduced form. Another 
way of putting this is that，if co is the set of matrices of relative 
to some basis (q ， e 2y …， e n ) y then the existence of a proper in¬ 
variant subspace implies that there exists a non-singular matrix 
(fj) such that all the matrices of (/x)co(m ) -1 have the same reduced 
form (that is, with the same r for all). 

The converse is valid, too. For suppose that all of the ma¬ 
trices of (jLt)co(/x) _1 have the reduced form (2). Then, if fi = 
H/fjLijej, the matrices of 0, relative to ( 九 / 2 ， • • * ， A) constitute the 
set (m)co(/x) _1 . Because of the form of these matrices，relations 
(1) hold, and these show that the space © = [ 九 / 2 ， • • •, / r ] is 
invariant under 0. 

EXERCISES 

1. Let 0 be a set of linear transformations, and let 5 be a linear transformation 
that commutes with every A 2,^1. Show that if © is an invariant subspace rela¬ 
tive to then is also invariant. Also, show that the subset 況 of vectors 

8 @ such that yB = 0 is invariant relative to 0. 

2. Prove that a subspace © is invariant relative to a set 0 if and only if the 
following operator condition holds: The relation EAE — EA holds for every 
projection E onto @ and every A 

2. Induced linear transformations. If © is a subspace invar¬ 
iant under 0, then the linear transformations A zQ, induce trans¬ 
formations in ©. It is evident that these transformations are 
linear. We shall now show that in a certain sense the A also 
induce linear transformations in the factor space 3i = 5R/©. We 
recall that a vector ^ of S is a coset consisting of the vectors of 
the form x + y where x is fixed and y ranges over ©. li A 
(x - y)A = xA yA = xA + y r where y f = yA e Hence 
the image of any vector in the coset ^ is a vector in the coset 

xA determined by xA. Thus the mapping A that associates 

with x the vector xA of ^ is single-valued. We call A the trans¬ 
formation induced by A in This mapping is linear，since 

(^1 + = (^1 + — ((^i + x 2 )y 4 ) = {x\A + 

= {x\A) + {X2A) = X\A + X2A 
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and 

{ax) A = {ax^A = {{ax) A) = {a{xA)) = a{xA) = ol{xA). 

When there is no risk of confusion, we shall simplify matters by 
denoting the induced transformation by A also. 

On the other hand, it is sometimes necessary to distinguish 
carefully between the transformations A and A. The precise re¬ 
lation between these can be made explicit in the following way: 

Consider the mapping P: x x = x ® oi ^ onto 沆 . It 
is immediate from the definitions of the compositions in 沆 that 
P is a linear transformation of 5K onto 沉 . We shall refer to P as 
the natural mapping of onto 沆 . Now we have defined A by 

the rule that xA = xA. Thus we have the relation PA = AP 
connecting yf and A. 

Now suppose the basis ( 九 / 2 ， • • . ， /n) is chosen as in the pre¬ 
ceding section so that ( 九 / 2 ， • . *,/r) is a basis for Then it 
is clear from the first set of relations in (1) that the matrix 


戸 11 卢 12 • • • 3 lr~ 

戸 21 卢 22 •- •戸 2 r 

• • • • • • 

-3rl 3r2 • • • 3rr- 

is a matrix of the linear transformation induced by A in the in¬ 
variant subspace ©. Moreover，by the second set of equations 
in (1) we have 

fkA = \ = 53 ^kl/l — S ^kl/b 

\ 1 , 1 r + 1 

Now we know that the vectors (/ r+1 ， / r + 2 ，• • *,7n) form a basis 
for 尕 . Hence these relations show that the matrix of A relative 
to this basis is the lower diagonal block which appears in (2) : 


々 r + l, r + l ... /^r + l,n 
A*+2，r + l * /^r+2，n 


L/^n ， r+ 1 


3nn 
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We have now found interpretations for the two diagonal blocks 
which occur in (2). It is natural to ask for the meaning of the 
remaining block, appearing in the lower left-hand corner. To ob¬ 
tain the significance of this block we observe first that [/ r +i，• • •， 
f n ] is a complement U of the space ©• The decomposition 
況 = ©㊉ U defines a projection E of dt onto ©• Since @ is in¬ 
variant relative to 0, EAE = EA holds for every A (Ex. 2, 
p. 117). We consider now the linear transformation AE — EA 
=AE — EAE. This transformation sends dt into More¬ 
over, if ye®, then y{AE — EA) = yA — yA = 0. It follows 
from this that AE — EA defines a linear transformation A E of 
尕 = 9?/© into ©. Thus we define 

xAe — 一 EA\ 

and, by the remark that we have made, we see that A E is single¬ 
valued. One verifies directly that A E is a linear transformation 
of into ©• Moreover, by definition we have the relation 

AE —- EA = PAe> 

We shall now show that the matrix 

f^r + 1,1 • • • ft + l.r] 


Wn，l … Pn，r J 

is the matrix of A E relative to the bases (/ r+1 ，• • （ /i，• • •， 

/ r ) for 尕 and ©• We have the relations 

fk^E ~ 一 KA) = JhAE 

r 

= iy k = 尸 + 1， •••，”， 
i=l 

which prove our assertion. 

EXERCISES 

1. Prove that a relation such as ^ + 5 =_C or AB = C for 5, C in 12 im¬ 

plies a corresponding relation J + B = C y JB = C for the induced linear trans¬ 
formation in 9?. _ .rv\ 

2. Show that A is 1-1 in 9J if and only if A is 1-1 in © and A is 1-1 in 9? 

= 況 /©• 
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3. Composition series. Let @ and U be invariant subspaces 
such that 5R 3 U ^ Then U = U/© is a subspace of 淠 = 
9?/©. If«eU,^ = ^ + © where u eU. Hence for any A in 12, 

uA — uA eU. This shows that U is invariant relative to the set 
0 of the induced linear transformations A in 

We shall now show that the converse holds, namely, any in¬ 
variant subspace of 沆 has the form U = U/© where U is an in¬ 
variant subspace of containing ©. Thus let U be a subspace of 
尕 invariant relative to Let U be the totality of vectors con¬ 
tained in the cosets that belong to U. If u x and u 2 eU y Ui = Ui 
+ © and ^2 = ^2 + © are in U. Hence Ui u 2 = ("i + u 2 ) 
+ © is in U. Hence Ui + u 2 e U. Similarly au for any a in 
A and any u in U. Since {u + = uA + © efl 3 uA eU. 

Thus U is an invariant subspace of 9?. Clearly U = U/©. 

A sequence of invariant subspaces 

(3) 0 (= c @ 2 匚 • • • c 备 = 況 

is called a composition series for dt relative to 12 if each is irre¬ 
ducible over © z -_i in the sense that there exists no invariant & 
such that ] ©i—i. By what we have shown it is clear 

that ©i is irreducible over if and only if is irre¬ 

ducible relative to the set of linear transformations induced by 
the A eQ>. The irreducible spaces 

(4) ©i, © 2 /©i, •**,©^-1 

are called the composition factors of the series (3). 

We now choose a basis (/i ， / 2 ，•. •，/«) for ©i. This can be 
supplemented to a basis (/i ， / 2 ，• • - ,/ ni+n2 ) for © 2 . Continuing 
in this way we obtain finally a basis (/i,/ 2 , • • •，/ n ) for 況 such 
that (/i ， / 2 ， • • •，/ ni+ ... +ni ) is a basis for 0 Z -. Then if ^ eQ 


ni 




= Pufh 

i 

/ = 1，2，…，… 

(5) 

hA 

ni + ri2 

= l^kl/h 

1 

々 = 衫 1 + 1， * • *, + ^2 


• • 

f v A 

打 1+ • • • 

= X) l^pqfqj 

1 

P = tl\ + + 1 ， •••， 

ni -tit = n 
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Consequently the matrix of A relative to our basis has the form 



in which the “blocks” above the main diagonal are all 0. The 

COSetS • • • +ni_i + l> Jn\-\- • - - +n _i+25 • . fn\-\- • • • +7i*) form 3 , t) 3 ,SlS 

for the factor space and by (5) we have 

_ _ niH - \-rii 一 

JtA = S Prsfs 

ni+ • — l + l 

if A denotes the transformation induced by A in the factor space 
© z 7©i_i. The matrix of A relative to this basis is therefore the 
diagonal block (ft) that appears in (6). Our assumption that 
©i is irreducible over means that it is impossible to find a 
matrix (w) such that all of the matrices (Mi) (ft) (Mt) 一 1 all have 
the same reduced form. 

It is easy to prove the existence of a composition series for any 
set 0. First, if 況 is irreducible，then 0 c : 況 is such a series. 
Otherwise let © be a proper invariant subspace. If © is irre¬ 
ducible relative to the set of induced linear transformations, we 
take ©i = ©. Otherwise we let be a proper invariant sub¬ 
space of ©. Now dim 9? > dim @ > dim &• Hence this proc¬ 
ess cannot be continued indefinitely. Eventually we get an irre¬ 
ducible invariant subspace ©i ^ 0. We repeat this argument 
with ^ = 9?/©i and the set 0 of induced transformations. Then 
we see that，if 沆 〆 0 (that is, ^ © 1 )， 沆 contains an irreducible 
invariant subspace @ 2 ^ 0. This space has the form © 2 /©i, and 
@2 is invariant relative to 12 and is irreducible over We con¬ 
sider next 9 J/© 2 . If this space is 〆0, we obtain in the same way 
a subspace © 3 invariant under 12 and irreducible over @ 2 - Since 
dim ©i < dim @ 2 < dim @ 3 < • • •，this process, too，breaks off 
after, say, t steps, with the space 5R. Then 0 c: c © 2 ^ • • • 

c ©f = 9? is a composition series. 
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4. Decomposability of a set of linear transformations. We 

consider now a decomposition of the space SR as 

(7) 9? = 9?i ㊉ 況 2㊉. ••㊉ 9?s ， 

a direct sum of the subspaces dU that are assumed to be invariant 
relative to Such a decomposition is called proper if each 
dti 0 and s > l. If 9? has a proper decomposition，we say that 
9? is decomposable relative to 12 and that 12 is a decomposable set of 
linear transformations. 

Clearly, a set of linear transformations which is irreducible is 
indecomposable. On the other hand，there exist reducible sets 
which are indecomposable. Hence decomposability is an essen¬ 
tially stronger condition than reducibility. We prove this asser¬ 
tion by citing the following 

Example. Let Q, consist of the linear transformation A with matrix 


L 1 OJ 

relative to the basis (^i, • • • ， e n ). Then e\A = 0 and eiA = ei—\ if i > 1. 

Hence the subspaces ©i = [^i, …， i = 1, 2 , •••,», are invariant. We 

shall show that these are the only non-zero invariant subspaces relative to A. 
For let © be such a subspace. Let h be the smallest integer such that 0 C ©/j. 
Then © contains a vector 

Ti^i + 72^2 H - h 7heh 

with yh 9 ^ 0. We may assume that 7 ^ = 1 so that 

y = 71^1 H - h yh-ieh-i + 办 e@. 

Then the vectors 

yA = 72^1 + … + 7 ^- 1^-2 + €h-i 
yA 2 = 73^1 H - h yh-ieh-z + e h -2 


are in ©. Evidently ei, …，作 are linearly dependent on these vectors. Hence 
0^ C @ and so © = Since CZ if i < j y it is clear that no two of 
these spaces are independent. Hence 9i cannot be written as a direct sum of 
these invariant subspaces. 


01 

01 

t I : _ 
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If 9? is a direct sum of the invariant subspaces dU ， i = 1 ， 2, • • •， 
s, s > l y we may choose a basis (/i ， / 2 ， . • . ， /n) for 9? such that 


(8) (^/* 符 1+ .. •+ni_i + 1 ， ...+rit._i+2 ， y J" {- • • • 

is a basis for Since is invariant, any vector in (8) is trans¬ 
formed into a linear combination of these vectors by any A 
Hence the matrix of A has the form 


⑼ 








Here the diagonal block is the matrix of the transformations in¬ 
duced by A in dii relative to the basis (8). Conversely, if Q is 
any set of linear transformations and there exists a basis ( 九 / 2 , 
• • 、 /n) such that all the matrices relative to this basis have the 
form (9)，then 9? is a direct sum of the invariant subspaces 

~ [/m+ •..+ni 一 1+I5 . • * y */ni+ • • • 


Suppose now that / = 1 ， 2 ， … ， j ，are the projections de¬ 
termined by our decomposition. We recall that, if 


(10) x = Xi + x 2 -\ - h 

where e 0^， then Ei is the mapping x —> We have also 

seen (p. 60) that the following relations hold: 

(11) Ei 2 = Ei y EiEj = 0 ， i 9^ j y Ei + E 2 + • •' + E s = 1 . 

The space 礼 . = 说 Ei. Hence each Ei is ^ 0. Now let A zQ.. 
Then 

xA = X\A -f- + • • • + x s A 


and, since 況 / is invariant, XiA 8 9^. Thus the component in dti 
of xA is XiA y or, 

( 12 ) xAEi = XiA = xE{A. 

This shows that the projections Ei commute with every yf e 0. 
Conversely suppose the Ei are linear transformations 〆 0 which 
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satisfy (11) and which commute with every A Then we 
know that dt = 況 i ㊉ 況 2 ㊉.••㊉ where = ^tEi ， More¬ 
over, if e 12 and Xi e 9? z -, then X{ = xEi and X{A = xEiA = 
{xA)Ei 8 Hence 9?^ is invariant relative to 12. 

If ^ > 1 in our discussion, each 9?^ is a proper subspace and 
each Ei ^ 1. Hence we see that, if 12 is a decomposable set of 
linear transformations, then there exist projections # 0 ， 〆 1 
which commute with every A in 12. Conversely^ if E\ is a pro¬ 
jection # 0，〆 1 which commutes with every A in ^ then E 2 
=1 — Ei has these properties also. Moreover, Ei and E 2 are 
orthogonal. Hence 9? = 9iEi ㊉ dtE 2 and the dtEi are proper in¬ 
variant subspaces. This proves the following important criterion. 

Theorem 1. A set Q of linear transformations is decomposable 
if and only if there exist projections £ 〆0，〆 1 which commute 
with every transformation in 0. 

EXERCISE 

1 . Show that, if is irreducible (indecomposable) relative to a subset of 12, 
then it is irreducible (indecomposable) relative to 12. Use this to prove that the 
set of linear transformations corresponding to the set of triangular matrices 

'ocn 0 • 

«21 Ot22 

• • 

• • 

• • 

^n2 <^nn- 

is an indecomposable set. 

5. Complete reducibility. If and © 2 are invariant sub¬ 

spaces under then so is 0i fl © 2 and ©1 + ® 2 - Hence the 
totality of invariant subspaces is a sublattice L Q of the complete 
lattice L of subspaces of 9?. It is natural to apply lattice-theo¬ 
retic ideas in the study of the set L n and this is，in fact, what we 
have done in the foregoing discussion. Thus the statement that 
12 is irreducible amounts to saying that contains just two ele¬ 
ments. Also the statement that 卩 is decomposable may be for¬ 
mulated as a property of the lattice L Q . Of the properties of L 
we singled out in Chapter l y it is clear that the chain conditions 
and the Dedekind law are preserved in passing to the sublattice 


SETS OF LINEAR TRANSFORMATIONS 


125 


L a . The complementation property of L, however, may or may 
not be valid in It certainly holds if Q consists of the identity 
1 only, for then L a = L. Also, if 12 is irreducible, then L a is com¬ 
plemented, and there are other less trivial examples which will be 
encountered later. 

If L q is complemented, we say that 12 is a completely reducible 
set of linear transformations. This, of course, means that, if 
© is any invariant subspace relative to 12， then there exists a 
second invariant subspace such that 5R = @ © &. This con¬ 
dition is admittedly rather elusive since it applies to every in¬ 
variant subspace It is therefore remarkable that this (pos¬ 
sibly infinite) set of conditions can be replaced by the single con¬ 
dition given in the following 

Theorem 2. A set Q of linear transformations is completely re¬ 
ducible if and only if 9? can be expressed as a direct sum of sub¬ 
spaces that are invariant and irreducible relative to 0. 

Sufficiency. Let 況 = 9ii ㊉ 況 2 ㊉ • • •㊉ 況 s where the are ir¬ 
reducible invariant subspaces. If @ is any invariant subspace, 
either @ = 9? or there exists an 9^， say such that 9?i ^ 
Then we set ©i = @ + SRi. Now @ fl e L Q and since © 门況 i 
is contained in the irreducible invariant subspace dt\ y either 
© 门況 i = 況 1 or © fl 9^ = 0. Since © 门 9?i = 況 1 is equivalent 
to © 2 況 1 ， we must have © fl 況 x = 0. Hence ©i = © + 9?i = 
@ ㊉ 況 i. We now repeat the argument with in place of 
Then either ©i = SR, in which case 9ii is a complement of or 
there exists an 队 ， say 況 2 , such that = ©i + 況 2 = ©i ㊉ 沉 2 . 
Then © 2 = © ㊉ 況 1 ㊉ 況 2 . Eventually we obtain for a suitable 
choice of the notation that 9i = ©㊉ 9?i ㊉ 況 2 ㊉ •• •㊉ 沉 a. Then 
@’ = ㊉ 況 2 ㊉ •. •㊉ 3U is a complement of © in 9?. 

Necessity. Suppose that 9^ is an irreducible invariant subspace 
of Then either 9i = is irreducible or = 9^ ㊉ 9V where 
9J/ is an invariant subspace ^ 0. Next let 況 2 be an irreducible 
invariant subspace of 9?/. If 9?/ = 沉 2 ， we have 9? = 3?i ㊉ 況 2 , 
irreducible invariant as required. Otherwise, + 9? 2 has a 
complement ^2 invariant. Then 9?= 況 1 ㊉ 況 2 ㊉ ^2 - We 
repeat the argument with 況 2 ’. This leads finally to 5K = 沉 1 ㊉ 
況 2 ㊉ • ••㊉ where the are invariant and irreducible. 
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EXERCISES 

1 . Use the argument in the first part of Theorem 2 to show that, if 9? is a sum 
(not necessarily direct) of the irreducible invariant subspaces then 況 is 
completely reducible relative to 0 . 

2. Show that, if w is any set of diagonal matrices, then the corresponding set 
^2 of linear transformations is completely reducible. 

3. Let G = 6 * 2 ，• • •, } be a finite group of linear transformations, that 

is, a subgroup of the group of 1-1 linear transformations of 9? over A. Assume 
that the order w of G is not divisible by the characteristic of A. Show that, if 
@ is an invariant subspace relative to G and £ is a projection onto ©, then 

I / m \ • 

Eo = — ( 2 SiES^ 1 ) is a projection on © which commutes with the S{. Hence 

w \i=i / 

prove the important theorem : 

Any finite group of linear transformations whose order is not divisible by the 
characteristic of the division ring is completely reducible. 

4. Let 12 be an arbitrary set of linear transformations and let E be any projec¬ 

tion such that EA = EAE holds for every A in 12. As in § 2 define the linear 
transformation Ae of into @ by xAe — x{AE — EA). 

Prove that, if there exists a linear transformation Z) of into @ such that 
Ae = AT) — DA holds for all A 、 then © has a complementary invariant sub¬ 
space. 

5. Prove that if 12 is completely reducible, and © is an invariant subspace, 
then the set of linear transformations induced in © is completely reducible. 

★6. Relation to the theory of operator groups and the theory 
of modules. The theory of sets of linear transformations that 
we are considering here can be regarded as a specialization of 
the theory of groups with operators (M-groups).* A reader who 
is familiar with the latter concept will observe that we are deal¬ 
ing here with the additive group 9? considered as a group with 
operator set M = U 0, A ； the set of scalar multiplications. 
The concept of M-subgroup evidently coincides with that of in¬ 
variant subspace relative to the set of linear transformations 12. 
Hence the concepts of reducibility, decomposability, composition 
series coincide with these concepts for the M-group 9?. 

The theory of M-groups also suggests the introduction of the 
following concept of homomorphism between invariant subspaces 
or factor spaces relative to the set A mapping 6 is said to be 
an Uinear transformation of one such space into a second one if 
0 is a linear transformation and {xA)B = {xQ)A holds for all the 
induced transformations A Similarly we say that two sub- 


* See Volume I, Chapters V and VI. 
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spaces / = 1 ， 2， are Q^isomorphic or equivalent if there exists 
a 1-1 12-linear transformation 0 of 況 i onto 況 2 . If e 2 y . • G) 
is a basis for then (eid y e 2 S > • • •， e r 6) is a basis for 9? 23 and it 
is immediately verifiable that every A has the same matrix rela¬ 
tive to (e ly •••〆》•) and to (ej， …， e r 0). It follows that for arbi¬ 
trary choice of bases in 9^ and 況 2 the matrices («i) and (a 2 ) of 
any A eQ, are related by (a 2 ) = (m)(^i)(m) _ 1 where the non¬ 
singular matrix (ju) is independent of A. 

We can now state the following two fundamental theorems 
which are taken from the theory of M-groups. 

Jordan-Holder theorem. 7/0 cz c 9t 2 ^ * * * 匚见 = 9? and 

0 cz cz ©2 ^ • • • c = 沉 are two composition series for a set 
0 of linear transformations ^ then t — u and the factors of composition 
dti/dti—iy can be put into 1-1 correspondence in such a 

way that corresponding pairs are Qi-isomorphic. 

Krull-Schmidt theorem. If 说 = ㊉ 沉 2 ㊉…㊉ 況 n = ©i ㊉ 

@ 2 ㊉. ••㊉ ©a ； are two decompositions of 9? into non-zero invariant 
and indecomposable subspaces relative to then h — k and，if the 
are suitably ordereH and are ^l-isomorphic. 

We refer the reader to Volume I, Chapter V， for the proofs of 
these theorems. 

We can also absorb the present theory into the theory of mod¬ 
ules. This comes about from the fact that 況 is commutative. 
Hence the endomorphisms of form a ring and the set M = 
U 0 generates a subring o(M) of the ring of endomorphisms of 
5R. We call o = o(M) the enveloping ring of M. Now if © is a 
subgroup of the additive group 況 ， then the set of endomorphisms 
of 況 that map © into itself is a subring of the ring of endomor¬ 
phisms. Hence if © is an 12-subspace，this subring contains M 
and consequently it also contains o(M). Thus we see that any 
fl-subspace of 5K is an o(M)-subgroup. The converse is, of course ， 
clear. In a similar manner we see that, if d is an O-linear trans¬ 
formation, then 6 is an o(M)-homomorphism, and generally speak¬ 
ing nothing is changed in shifting from the set M to its envelop¬ 
ing ring. We have seen that in dealing with a ring of endomor¬ 
phisms it is often convenient to regard the underlying group as 
a module. 
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It is usually difficult to obtain the structure of the enveloping 
ring o(M) and, when this is the case，there is no particular gain 
in shifting from the point of view of sets of linear transformations 
to that of modules. If △= 伞 is a field, the problem of determin¬ 
ing the structure of o is easier than in the general case. Here we 
note also that is contained in the ring of linear transformations 
and o can be regarded as an algebra over Consequently in 
this case one speaks of the enveloping algebra of the set ^2. 

7. Reducibility, decomposability, complete reducibility for a 
single linear transformation. We adopt again the original point 
of view and we consider in this section the special case in which 
0, consists of a single linear transformation and △= 中 is a field. 

If/ is a non-zero vector in 沉 ， then the cyclic subspace {/} is 
an invariant subspace ^ 0. Let ju/(X) be the order of / and sup¬ 
pose that juy ( 入 ) = w(X)v(X) where 7r ( 入 ) is irreducible and has posi¬ 
tive degree and leading coefficient = L Then g = fv{A) has 
order 7r(X). Thus contains a vector whose order is a prime. 
Suppose now that A is irreducible. In this case we have = {g} 
where 入 ) = 7r(X) a prime. Conversely suppose that dt has 
this form and let @ be a subspace 〆 0 invariant under A. If h 
is a vector in ©，the order /xa(X) is a factor of 7r(X). Hence if 
A 〆0, ma(X) = 7r(X). Hence dim \h\ = deg 7r(X) = dim . It 
follows that \h\ = {g} . We have therefore proved the following 

Theorem 3. A linear transformation A in ^ over 电 is irreducible 
if and only if it is cyclic and has prime minimum polynomial. 

We consider next the question of decomposability of a single 
linear transformation. We know that dt = ㊉ {A} © ... © 

{ ft ]. Hence a necessary condition for indecomposability is that 
t = that is, 9? = {/} is cyclic. We have also seen that, if the 
minimum polynomial of a cyclic linear transformation can be 
expressed as mi 00 m 2 ( 入 ） where (Mi(X) ， M 2 (X)) : = 1， then 9? = {^i} 
© {^ 2 } where jJL gi (k) = 入 ). Hence a cyclic linear transforma¬ 

tion is decomposable unless its minimum polynomial has the 
form 7r(X) fc ， 7T(X) prime. Conversely, these conditions are suffi¬ 
cient; for suppose that A is cyclic with 7r ( 入 ) & as its minimum 
polynomial. Assume that 沉 = 9fi ㊉ 況 2 where is invariant 
under A, Let be the minimum polynomial of the transfer- 
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mation induced by A in dti. Then since Xiir{A) k = 0 for all Xi 
in dtiy Mi ( 入 ） I Tr(X) k . Hence 〜 (X) = ^(X)* 4 , ki < k. Now X{ir{A) ki 
= 0 for all Xi in 9?^ and this implies that，if ^ = max ( 是 k 2 ) y 
then 7r(^/)^ = 0. Thus k — k and so we may suppose that k\ 
= k. This means that the minimum polynomial of A in 9?x is 
^(X)^. Consequently there exists a vector/ x in dti whose order 
is w(\)\ Then dim {/ x } = deg7r(X)* = dim Hence {/i} =9? 
and since {/i} £ 9?i ， 9?i = Thus the decomposition 9? = 9?i 
㊉ 況 2 is not proper. 

Theorem 4. A linear transformation A in 9? over 龟 is inde¬ 
composable if and only ij it is cyclic and its minimum polynomial 
is a power of a prime. 

We suppose next that A is completely reducible. Then = 
沉 l ㊉ 況 2 ㊉ • • •㊉ 況 s where the dti are invariant and irreducible. 
By Theorem 3 the minimum polynomial of A in 仏 is a prime 
7Ti(X). It follows that the minimum polynomial ju(X) of yf in 5R 
is the least common multiple of the 〜 ( 入 ). Hence /z ( 入） is a product 
of distinct primes. Conversely, let ^ be a linear transformation 
whose minimum polynomial jit(X) is a product of distinct primes. 
Then each invariant factor has this form too. Hence the ele¬ 
mentary divisor ideals are of the form (^(X)), 7Ti(X) a prime. 
Now, we know that this implies that 況 is a direct sum of cyclic 
subspaces dti = where the order 入） = n ( 入 ) • By Theo¬ 
rem 3 each is irreducible. Hence is completely reducible. 
This proves the following 

Theorem 5. A linear transformation A in dt over 龟 is completely 
reducible if and only if its minimum polynomial is a product of 
distinct primes. 

EXERCISES 

1. Let A be cyclic with minimum polynomial /x(X). Show that, if © is in¬ 
variant under A 、then © is a cyclic subspace. Show that the invariant subspaces 
of 9? can be put into 1-1 correspondence with the factors having leading co¬ 
efficient 1 of JLt(X). 

2. Let 中 be infinite and let = {/i} ® {/之} be a decomposition of 9? relative 
to A such that M/i (人 ) =M/ 2 W = ?r(X) a prime. Show that 9? has an infinite 
number of subspaces invariant under A, 

3. Prove that, if is infinite, then the number of invariant subspaces relative 
to A is finite if and only if A is cyclic. 
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8. The primary components of a space relative to a linear 
transformation. The decomposition of a vector space into inde¬ 
composable subspaces relative to a linear transformation is not 
uniquely determined. On the other hand, as we shall show in 
this section，there is a decomposition which is not as refined as 
the one into indecomposable components but which has the im¬ 
portant advantage of uniqueness. 

Let ju(X) be the minimum polynomial of A and let 

(13) MW = 兀 1( 入 ) 、 * 2 ( 入产 … 7T S (入产 

be the factorization of 从 ( 入 ） into powers of distinct irreducible 
polynomials having leading coefficients equal 1. Let 況 i be the 
subspace of vectors Xi e 9? such that 

(14) XiTTi{A) ki = 0. 

Then we assert that the spaces are invariant relative to A and 
that 

(15) 況 = 沁 ㊉ 況 2 ㊉…㊉ 況 s . 

The invariance of the dti is an immediate consequence of the fact 
that iTi{A) ki commutes with A (cf. Ex. 1 ， p. 117). The proof of 

(15) can be obtained by using the results of the preceding sec¬ 
tion; however，we shall give an independent discussion that has 
some points of interest of its own. 

We note first that the polynomials 

(16) = M(X) / 7Ti(\) ki = 

Tn ( 入产 … TTq ㈨ ‘V 叫 ( 入产 1 … w s (K) k % / = 1 ， 2, 

are relatively prime. Hence there exist polynomials ^i(X )， 
02( 入 )， • • • ， 0s(X) such that 

(17) 令 i(X)Mi ( 入 ） + 02( 入 ) M2( 入 ） + • • • + 0s(X)Ms(X) = 1. 

We can substitute A in this relation and obtain 

(18) 0i(yf)/Xi(yf) + 02 (^)m2(J) + • • • + <1>s{A)ix 8 {A) = 1. 

Since ( 入 ） is divisible by /x(X) if i 9^ j y 

4>i{A)iXi{A)<t)j{A)iXj{A) = 0 . 




SETS OF LINEAR TRANSFORMATIONS 


131 


We set Ei = Then this relation reads 

(19) EiEj = 0, i j 
and (18) becomes 

(20) + £ 2 + * * * + £« = 1. 

If we multiply this relation by Ei and use (19)，we obtain 

( 21 ) Ei 2 = 

Thus the Ei are orthogonal projections with sum 1 and therefore 

0? = ㊉ dtE2 ㊉. ••㊉ ^ftE s . 

Since the Ei are polynomials in A, they commute with A\ hence 
the spaces dtEi are invariant relative to A. We shall now show 
that dtEi coincides with the space 況 i of vectors Xi such that 
XiTTi{A) ki = 0. First let w e Thenjy t - = uEi = u4>i{A)iXi{A). 
Since = ju(X), this gives 

yiin{A) ki = u<t>i{A)iXi{A)Tri{A) ki = u^i{A)\x{A) = 0 . 

Hence jy t - e 9^. Conversely, let 

X = — X 1 I X 2 I * I X gy 

where xj e dtEj, be a vector in dti- Then 

0 = XTTi{A) ki = XiTTi{A) ki + + • • • + X s Ti(A) ki 

and since XjTr^A) 1 ^ e dtEj each 

XjTTi{A) ki = 0. 

On the other hand ， XjWj(A) k} ' = 0, and since 7^( 入 ) ，〜 ( 入 ） are dis¬ 
tinct if i 9 ^ j y this implies that Xj = 0 for j ^ /. Hence x = Xi e 
dtE{. This completes the proof that = dtEi. 

It is clear that the minimum polynomial of A acting in 礼 • is 
of the form 7Ti(X)^ 5 U < ki， Moreover, if % = 巧 + <v 2 + •. . + 
where Xi e and m*(X) = xi(X) Zl 7r 2 (X) Z2 - - - then x i fX ¥ {A) 

= 0 for all /. Hence x^{A) = 0 and = 0. Consequently 

M ( 入 ）I M*00. Evidently this implies that /i(X) = and that 

li = ki for i = 1, 2 y •••，』• This completes the proof of the 
following 
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Theorem 6. Let /x(X) be the minimum polynomial of the linear 
transformation A in dt over $ and let (13) be the factorization of 
ju(X) into prime powers. Then，ij 说 i is defined to be the subspace of 
vectors Xi such that Xiiri{A) ki = 0, 

沉 = 3^ ㊉ 況 2 ㊉.••㊉ ％ 

and the minimum polynomial of the induced transformation in dti 
is 7 Ti(\) k \ 

We shall call the spaces dti the primary components of 9? rela¬ 
tive to A, The projections Ei determined by the decomposition 
(15) will be called the principal idempotent elements of A, 

We specialize now by assuming that $ is algebraically closed. 
In this case the 7r t ( 入 ） are of first degree ， say, Wi(X) = \ 一 pi. 
We set 

Ni = {A — Pi\)Ei 

so that 

(22) A = AE\ AE 2 + • • • + AE S = (piEi + A^i) 

. + (P 2 五 2 + # 2 ) + • • • + (psE s + 

Evidently 

(23) N{Nj = 0, EiNj = 0 = NjEi 
if i 7 ^ j and 

(24) EiNi = Ni = NiE{. 

Also N{ ki = {A — pi\) ki Ei = Ei{A — 产 and if x is any vector 
then xEi e dti ， Furthermore Xi{A — Pil) ki = 0. This proves that 

(25) Ni ki = 0. 

The nilpotent linear transformations will be called the prin¬ 
cipal nilpotent elements of A. Like the Ei these linear transfor¬ 
mations are polynomials in A. 

EXERCISE 

1 . Let $ be algebraically closed of characteristic 0 and suppose that Ei, Ni, i 
=1, 2, J, are the principal idempotent and principal nilpotent elements of 
A and that A — ^{piEi + Ni). Show that, if is a polynomial, then 

令 ⑻ = ⑹厶 + TV? + • • . + df 财 “ • 
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9. Sets of commutative linear transformations. We suppose 
now that 卩 is a set of commutative linear transformations in 9? 
over <l>. Assume first that 12 is indecomposable. Then we shall 
show that the minimum polynomial of any ^ e 12 is a prime power. 
For otherwise we can obtain a proper decomposition of 沉 as 
況 l ㊉ 況 2 ㊉. ••㊉ 沉 s where the dti are the primary components 
relative to A. Now it is clear that if 5 is a linear transformation 
that commutes with A then dtiB C 況 “ Hence the 9?^ are in¬ 
variant relative to 12, and this contradicts the indecomposability 
of 12. 

Assume next that 9? is irreducible. Then we assert that the 
minimum polynomial ju ( 入 ) of every A is irreducible. For if 7r ( 入 ) 
is an irreducible factor of then the space © of vectors y such 
that = 0 is ^ 0. Evidently © is invariant relative to 

Hence © = 5R and 7r(X) = m ( 入 ) • 

Now let 12 be an arbitrary commutative set of linear transfor¬ 
mations. We first decompose SR as 

9 t = 況⑴ ㊉ 況⑵ ㊉ • •• ㊉ 況⑷ 

where the 況⑷ are indecomposable. It is clear that the transfor¬ 
mations induced by the yf eQ in any invariant subspace and in 
any factor space commute. This holds in particular for the 9? ⑴. 
Our result in the indecomposable case ， therefore，shows that the 
minimum polynomial of any A acting in 況⑷ is a prime power 
Ti(\) ki . We now choose a composition series 

(26) 0 c c dt 2 (i) c • • • c = 沉 ⑷ 

for each 5R (i) . Then each factor space 5Ry (i) /9fy-i (l) ^ irreducible 
relative to the induced transformations. Hence the minimum 
polynomial of the transformation A induced by A in 
is irreducible. On the other hand, iri{A) kx = 0. Hence the mini¬ 
mum polynomial of A is 〜 ( 入 ). 

We now choose a basis for 況⑴ corresponding to (26)，that is, 
the first group of vectors is a basis for 9^ ⑴， the second group 
supplement these to give a basis for 況 2 ⑴， etc. The bases thus 
determined for the different 5K (i) constitute a basis for 9f. With 
respect to this basis the matrix of A has the block form 
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(27) 


■(«i) 

O2) 


(«a)J 

where the block (o^) that goes with 況⑷ has the form 

⑹ 0 

(28) ' 


L * ⑹」 

The matrix ( 馬 ） is a matrix of the induced linear transformation 
A, Hence its minimum polynomial is 巧 ( 入 ) • 

Suppose now that 中 is algebraically closed. Then 7ri ( 入 ） = 
\ 一 Pi. Hence A = p z l is a scalar multiplication in 
Since any subspace is invariant relative to a scalar multiplication, 
it follows that is one dimensional. Hence the ma¬ 

trices (ft) are one-rowed. Our final result can therefore be stated 
as the following theorem on matrices: 


Theorem 7. Let 龟 be an algebraically closed field and let co be 
a set of commutative matrices belonging to Then there exists a 
non-singular matrix (jx) in such that 

f(«i) ' 

(«2) 

( M )(a)( M )— 1 = • 


where 


L («n)J 

•Pi O' 

Pi 

(oii) = • 


for all (a). 




SETS OF LINEAR TRANSFORMATIONS 


135 


EXERCISES 

1 . Let 中 be the field of complex numbers and let 



Verify that (a)(J3) = ⑹ (a) and illustrate Theorem 7 with this pair of matrices. 

2 . (Ingraham) Let be a matrix in the block form 

A\\ A\2 … Aim 

A2I A22 為 m 

• • 參 • • • 

^ml ^m2 • • • ^ mm 


where the Aij are r X r matrices with elements in an algebraically closed field. 
Assume that the commute with each other and define 

detij yf = 2 士 A\iyA2i 2 '' - ^mim 

where the sum is taken over all permutations ii y t m of 1, 2, • • •, w and 

the sign is + or — according as the permutation is even or odd. Use Theorem 7 
to prove the following transitivity property of determinants 

det(det« A) = det A. 


(This holds for arbitrary base fields. Compare Sec. 9, Chapter VII.) 

3. (Schur) Show that the maximum number of linearly independent commu¬ 


tative matrices which can be chosen in ^> n is 



--1, where, in general, [a 


denotes the greatest integer in the real number a. 





BILINEAR FORMS 


This chapter is devoted to the study of certain types of func- 
tions，called bilinear, which are defined for pairs of vectors (x, y f ) 
where ^ is in a left vector space 9? and jy’ is in a right vector space 
況 ’. The values of g(x y y f ) are assumed to belong to and the 
functions of one variable and g y >{x) = g(x y y f ) 

obtained by fixing the other variable are linear. Of particular 
interest are the non-degenerate bilinear forms. These determine 
1-1 linear transformations of 況 ’ onto the space of linear functions 
on dt. Consequently, if ^ is a linear transformation in 況 ， there 
is a natural way of associating with it a transposed linear trans¬ 
formation in 9?’. 

If the division ring A possesses an anti-automorphism, then 
any left vector space 9i over A can also be regarded as a right 
vector space over A. Hence in this case one has the possibility 
of defining bilinear forms connecting the space with itself. Such 
forms are called scalar products. Their study is equivalent to 
the study of a certain type of equivalence for matrices called co- 
gredience. The most important types of scalar products are the 
hermitian，symmetric and alternate scalar products. We shall 
obtain canonical matrices for such forms, and, in certain special 
cases that are of interest in elementary geometry, complete solu¬ 
tions of the cogredience problem will be given. We shall also 
prove Witt’s theorem for hermitian forms and apply it to de¬ 
fine the concept of signature for such forms over an arbitrary 
division ring of characteristic 〆 2. 
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1. Bilinear forms. If 9? is a (left) vector space over A, we have 
defined a linear function as a mapping x —^ f{x) e A such that 

(1) Ax +y) =/0) +/0) ， f(ax) = a/O). 

These mappings form a right vector space 況 * relative to the com¬ 
positions 

(2) (/ + g)(x) =/(x) + g(x), (/a)0) = 

As we have seen，these definitions imply that, for each fixed vec¬ 
tor % e 況 ， the mapping / —^ x(f) = /(x) is a linear function in 
9?*. Because of this symmetry it is natural to regard /(x)= 
x(f) as a function of the pair x e 9?，/e We therefore denote 
the value f(x) as /)，and the above equations now read 

⑶ s(x + yj) = s(x y f) + s{yj), s{axj) = as(x y f) 

⑷ s{xj + g) = s(x y f) + s(x y g) y s(x y /a) = s(x y /)a. 

We shall now generalize this situation by assuming that is 
any right vector space over A. Then a function g(x y y r ) defined 
for all pairs (%， y r ) y x in 9i, y f in 9?’， with values g(x y y r ) in A is 
called a bilinear form if 

(5) 《Oi + ^y r ) = 《 Oi ， y) + 《 02 ，）’)， 

g(ax,y f ) = ag(x,y f ) y 

⑹ +y2 f ) = gi^yyi) + W )， 

g(x,y ; a) = g(x,y f )a. 

Clearly s(x y f) is a bilinear form for the space SR and its conjugate 
space 

On the other hand，as we proceed to show, the conjugate space 
9?* can be used to give an alternative definition of a bilinear form. 
First，let g(x y y f ) be a bilinear form connecting the left vector 
space dt and the right vector space SR’. We fix the vector y f and 
regard g(x y y f ) as a function of Accordingly we write g(x y y f ) 
= g y ^(x). Then, by (5) ， g y ^(x) is linear, that is, it belongs to the 
conjugate space 9t*. Now let y r vary and consider the mapping 
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y f —> g y , e 5R*. We denote this mapping as R and we observe 
that, by (6), R is linear，since 

gy^+vA^ = g( x ^yi 十力’） = g(^,yi) +<? 0 ，） 2 ’） 

= gyA X ) + gyA X )y 

gy f a(^) = g^yy'od = 《 0 , = gy f {^)0L. 

In a similar manner，if we fix x，then the function g x {y f ) = g(^, y r ) 
is linear in y f . Hence g x is in the conjugate space (SR 7 )* of 
The mapping L: x g x is a linear transformation of 9? into ( 沉 ’)*. 

Conversely, suppose that we are given a linear transformation 
R: y f —> gy^(x) of the right vector space into the space 5K* of 
linear functions on 9?. Then we can regard g y ^(x) as g(x y y f ) y a 
function of (x y y f ) y x in ^ y r in and we can verify that this 
function is a bilinear form. Thus we see that an equivalent defi¬ 
nition for the concept of a bilinear form is that of a linear trans¬ 
formation of the right vector space JR 7 into the conjugate 9?* of 
9?. Similarly, we could also say that a bilinear form is a linear 
transformation of 9? into the conjugate space ( 沉 ’)* of 9?' The 
original definition, however，has the advantage of symmetry over 
the present formulations, and it will be given preference in the 
sequel. 

EXERCISE 

1 . Show that, if g(x, y f ) is a bilinear form and ^ is a linear transformation in 
8 J, then g(xA^ y r ) is a bilinear form. 

2. Matrices of a bilinear form. Suppose now that 9? and 況 , 
are finite dimensional and that (ei y e 2y …， e n )^ (/i’ ， / 2 ’， …， 

f n f, )y respectively, are bases for these spaces. We shall call the 
matrix 

~g^iy/i) g^u/2) - - - g{e u fn^Y 

⑺ g{e 2 yfl) 《 <> 2 ， / 2 ’ ） … g(e 2 yfn^) 

• 參 • • • • 

jOn ， /l’ ） 兄 0n ， / 2 ’ ） … 《 On ， /n〆)- 


the matrix of the bilinear form g relative to the given bases. The 
form is completely determined by this matrix ； for if x and y f 
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n n* 

are arbitrary in 9? and 況’， we can write x : =H ^iyy r = H//Vjy 

1 1 

and we obtain 

g{^yy f ) = 2//”y) = 2^(^//)^*- 

Hence g(x y y ; ) is known from the representations of x and jy' and 
from the entries g(ei,f/) of (7). Also it is clear that，if (fty) is 
any n X n f matrix with elements in A, then there exists a bi¬ 
linear form h(x y y f ) which has this matrix as its matrix relative 
to (e u e 2y …， e n ) y (/i ’，/ 2 ’， • . •，//); for we can define 

g(^y y f ) = 

and it is easy to verify that this function is bilinear. Since 
s( e bf/) = the matrix of g is the given one. 

We consider now the effect on the matrix (fi) of g(x,y f ) of 
changes of bases in the two spaces. Let (u u u 2y … ， u n ) be a 
second basis in ^ Ui = where (jjl) & L(A, n), and let (vi y 

v 2 \ • . • ， v n r f ) be a second basis in ?ft\ v k f = (v) e L(A y n r ). 

Then 

g{u h Vk) = ^fivi k ) = 

so that the new matrix is (m)(^)W ^ matrix equivalent to (0). 
We remark that in the commutative case this relation is usually 
encountered in a slightly different form. Here one generally con¬ 
siders all vector spaces as left vector spaces. Then the change of 
basis in 況 ’ reads — ^v k ifi y and the new matrix of the bilinear 
form is (m) ⑹ (")’ where {v) r is the transpose of the matrix 
W = (ni)- 

We return now to the general case of an arbitrary A. We have 
proved in Chapter II (p. 45) in connection with the theory of 
linear transformations that, if (0) is any rectangular matrix with 
elements in A, then there exist non-singular square matrices (fx) 
and (v) such that 

(8) ( M ) ⑹ ㈦ = diag{l，. •• ，： ! ， 0, •••，（)}• 


This matrix result yields the following fundamental theorem on 
bilinear forms. 
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Theorem 1. If g{^ y y f ) is a bilinear form connecting the vector 
spaces dt and 9?’， then there exist bases (u u u n ), (vi y v 2 \ 

•••，〜〆 ）Jor these spaces such that 

( 9 ) S( u iy v /) = s ij ^ 2, • • r 

g(u iy v/) = 0 if i > r or j > r. 

Evidently the number r is the rank (row or column) of the 
matrix Q3) of g(x y y ; ). An abstract characterization of this num¬ 
ber will be given in the next section. 

3. Non-degenerate forms. If g(x,y f ) is a bilinear form, the 
totality of vectors z edt such that g(z y y f ) = 0 for all y r z ^ is 
a subspace 沢 which we shall call the lejt radical of g. Similarly 
we define the right radical f as the subspace of 況 ， of vectors z f 
such that z f ) = 0 for all x. It is clear from the definition 
that the left (right) radical is just the null space of the linear 
transformation L (R) of 9? (9J0 into the space of linear functions 
on dt f (9?). If ** ' y/n ff ) is a basis for 9?’ and z e 況， then 

g(z y f/) = 0 for ) = 1， 2， . • • ， n’ • Moreover the n f equations 
g{z y f/) = 0 imply that g(z y x f ) = 0 for all x\ Hence these con¬ 
ditions are also sufficient that z Now let (ei y e 2 , • • •， e n ) be 

n 

a basis for 9? and write z = =X) ^i e i- Then 

l 

(10) 0 = g(z y //) = 2 rAy，i = 1，2， • • •， ；/， 

% =i 

are the conditions that z = e 9?. It follows that dim Vt is 
the maximum number of linearly independent solutions of (10). 
Hence dim Vt = n — r where r is the rank of ((3). Similarly we 
see that dim ^Sl f = n f — r. We remark also that，if we use the 
normalized bases given in Theorem 1， then we see that 5ft = 
[u r +u "r+ 2 ， •••，"」and %’ = br+ 1 ’， v r+2 \ • . v n /]. For it is 

clear that the Uj with j > r are in 9^. Moreover, if e 9?， 

then, in particular, for k < r, 

0 = (SjiUi, Vk) = 7k- 

n 

Hence the vector has the form 7j u jy and therefore it belongs 

r + 1 

to [" r +i， u r+2y • • .，"n]. This proves the assertion about 91. A 
similar argument applies to yi r . 
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We know that dim dtL + dim = n and dim + dim 9 f l / 
= n\ It follows that dim dtL = r = dim dl’R. 

The bilinear form g is said to be non-degenerate if 況 = 0 and 
= 0. Thus 足 is non-degenerate if the only vector z in such 
that g(z y y f ) = 0 for all is 2 = 0 and the only vector z f in 9? / 
such that g(x y z f ) = 0 for all x is z f = 0. If g is non-degenerate, 
then the mappings L and R are 1-1. Also since dim 91 = 0 = 
dim 況’， then n — r = n r . Thus we see that, if and dt f are con¬ 
nected by a non-degenerate bilinear form, then these spaces have 
the same dimensionality n. We recall also that a space and its 
space of linear functions have the same dimensionality. Hence 
the mappings L and R are 1-1 linear transformations of vector 
spaces into vector spaces of the same dimension. It follows that 
these are mappings onto the corresponding spaces. The relations 
n =： r — n f are also sufficient that the bilinear form be non-de¬ 
generate; for they clearly imply that dim ^ = n — r = 0 and 
dim ^ = n ; — r = 0. Our results can be summarized in the fol¬ 
lowing 

Theorem 2. Necessary and sufficient conditions that a bilinear 
form y f ) connecting and 欲 be non-degenerate are: 1) 9? and 
況 ’ have the same dimensionality^ 2) the matrix of the form relative 
to any pair of bases is non-singular. If g is non-degenerate and 
fi{y r ) is a linear junction on then there exists one and only one 
vector x in 说 such that g(x y y f ) = holds for all Also if 

/ 2 (^) is any linear function on 9J, then there is a unique vector y f 
in dt f such that g{x^ y r ^j = / 2 (^) holds for all x. 

If two vector spaces 況 and 況 ’ are connected by a non-degenerate 
bilinear form g y then we shall say that these spaces are dual rela¬ 
tive to g. Suppose that this is the case and let (e ly e 2y …， e n ) 
be a given basis in dt. We choose a basis (/ i ’，/ 2 ’，• • .，/ n ’） for 
9?’， and we obtain the non-singular matrix (0) where fty = g{e^ 
//). Now let {y) be any non-singular matrix in A n and let Vk = 
be the corresponding new basis in Then we have seen 
that the matrix of g(x y y r ) relative to the pair of bases ( 〜 e 2y 
.• • ， ^n)y ( 口 l’ ， v 2 \ • • • ， Vn) is ⑻ (v). Thus there exists a uniquely 
determined basis (ei y e 2 ’，•••，O for such that the matrix of 
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g relative to (e ly e 2y ••• ， e n ) y (q’ ， e 2 \ .•• ， e n f ) is the identity 
matrix, that is, 

(11) ) = J = 1 ， 2， •••，”• 

The e/ are obtained by taking {v )= ⑻ 一 1 . We call the bases 
(ei y e 2y • • • ， e n ) y « • • • ， e n f ) complementary bases for the dual 

spaces. Our argument shows that any basis in 況 （況 ’）determines 
a unique complementary basis in 況 ’ ( 5 K). 

Complementary bases have been used in our study of the no¬ 
tion of incidence between subspaces of 9 ? and of its conjugate 
space 9 ?*. These spaces are dual relative to the fundamental bi¬ 
linear form s(x y /) = f(x ); for if f{x) = 0 for all x y then / = 0 
by definition，and if % 〆 0 ， then there exists a linear function / 
such that /(x) ^ 0 . We can carry over to the general case the 
results on incident spaces. Thus let dt and 9 ^ be dual relative to 
y f )- Then if © is a subspace of 9 ?， we define the space 7 (©) 
incident to @ to be the subspace of of vectors y f such that 
y f ) = 0 for all e ©• In a similar manner we define j{&) 
for a subspace & of 況 ’ • We can prove as in the special case of 
dt and 5R* (p. 55) that dim y(@) = n — dim @ and = 

n — dim ©’• These relations, together with the obvious rela¬ 
tions y(i(©)) 2 3 imply that 

iOX©)) = ©> iC/(©’)） = ©’• 

Also, as in the special case of the space of linear functions we can 
prove that the mapping @ — )(@) is an anti-automorphism of 
the lattice of subspaces of 沉 onto the lattice of subspaces of 沉 ’. 
The inverse of this anti-automorphism is, of course, the mapping 
©’ 一 > J(©’). We leave it as an exercise to the reader to fill in 
the details of this discussion. 

EXERCISE 

1. Let and 9?’ be connected by the bilinear form g{x^y r ) and let and be 
the radicals determined by this form. If ^ + 91 8 and + 況 ’ e set 

g{x + 9t, jy r + 91’）= gix^y^. Show that this defines a non-degenerate bilinear 
form for the factor spaces dt/3l y 

4. Transpose of a linear transformation relative to a pair of 
bilinear forms. Let / = 1 ， 2 ， be a left vector space and let 
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5R/ be dual to dti relative to the bilinear form gi(xi y y/). If A is 
a linear transformation of into 況 2 ， then we know how to de¬ 
fine the transpose as a linear transformation of the conjugate 
space 9? 2 * into the conjugate space If/e 況 2 * ， then///* is ， 

by definition，the resultant Af. We can now make use of the 
equivalences Ri of 9?/ onto to define a linear transformation 
of 9? 2 / into dtiy namely, we set 

(12) A f = R^Rr 1 . 

Clearly this product can be defined since we have the following 
scheme of linear mappings: 


R -2 • 

9 V - 

今 沉 2 * 

^*： 

沉 2 * - 


Rr 1 ： 

- 



Also it is clear that A r is a linear transformation of 況 2 ’ into dti- 
We shall call this transformation the transpose of A {relative to the 
bilinear formsgi and 

We determine next the form of A r . Let jy 2 r e 沉 2 ’. Then jy 2 ^2 
is the linear function 《 2 (X 2 , J 2 O on the space - Moreover, 
is the linear function /1 on such that 

( 13 ) /1O1) = g 2 ^\ A y y 2 )^ 

Finally j 2 ’ 及 2 及 i -1 is the vector 力 ’ of 3V such that 

( 14 ) /iCvi) = = ^1(^1, 

holds for all Xi in 9^. The mapping A f sends y 2 f into yi and, 
according to the above equation ，yi = is the uniquely de¬ 

termined vector of such that 

( 15 ) 《 1O1J2’/) = ^2(^1^ J2O 

holds for all in 9^. 

Since the notion of duality is a symmetric one，we can inter¬ 
change the roles of 9^ and in the foregoing discussion. Thus 
if A f is a linear transformation of into SR/，then we define its 
transpose (relative to the given forms) to be the mapping A n = 
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LiA fJ¥ L 2 ~ l where Li is the fundamental equivalence of onto 
況 /* ， A r ^ is the transpose of A\ and L 2 is the equivalence of 
況 2 onto 況 2 ’*. In analogy with (15) we can verify that XiA n 
is the uniquely determined vector such that 

(16) g 2 (x 1 J / \ y 2 f ) = gii^iy y 2 

holds for all y 2 r in 況 2 ’- Now it is clear from (15) and (16) that ， 
if A r is the transpose of then A is the transpose of A r • Also if 
A rr is the transpose of A\ then A f is the transpose of A rt . Thus the 
two correspondences A A\ A r A" are inverses of each 
other. Hence A — is a 1-1 mapping of the set ^ 2 ) of 
linear transformations 9?i into dt 2 onto the set 8 ( 況 2 ’ ， 5 K/) of 
linear transformations of 9J 2 / into dti. Of course，this can also 
be seen directly from the definition of the transpose and the 
properties of the mapping A —> A r • 

The algebraic properties of the mapping A — A’ can also be 
deduced from the previously established properties of the map¬ 
ping A —> yf*. We state these without proofs: 1 ) If 5 is a sec¬ 
ond linear transformation of into then 

(17) {A + BY = + B\ 

2) If 9? 3 and 況 3 ’ are dual relative to the non-degenerate form 
Ss( x sy and C is a linear transformation of 9 ? 2 into 沉 3 ， then 
we denote the transpose of C relative to g 2y gs by C\ Also we de¬ 
note the transpose of AC relative to ^ 1 , ^3 by {AC)’• Then we 
have the relation 

(18) {ACY = CA f . 

3) As usual if we deal with a single vector space 9 ? and its dual 
relative to g(x y y f ) y then 1) and 2) show that the mapping A 

the transpose of A relative to is an anti-isomorphism of the 
ring of linear transformations in 9 ? onto the ring of linear trans¬ 
formations in 9 ?’. 

Finally, we wish to determine the relation between the ma¬ 
trices of a linear transformation and its transpose. Again let A be 
a linear transformation of into 況 2 and let 9 ^ ’ and ^2 be the 
duals relative to the forms and g 2 respectively. Let (e u e 2y 
… ， e m) be a basis for dti ； (ei\ <? 2 ’ ， ••• ， O, the complementary 
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basis in SR/. Similarly let ( 九 / 2 ， • • • ， A 2 ) be a basis for 況 2 and 
(/ 1 , ,/ 2 , , •- - , / n /) the complementary basis. Suppose that 


eiA ■ 

n2 

=> : ^ikfky 
k = 1 

/ = 1 ， 2 ， •••，〜 

fx r A f 

ni 

7=1 

/ = 1, 2 y … ， n 2 . 

Then the conditions 



g 2 (eiJ y /i f )= 


yield the relations 

an = 

an 


for the matrices. Thus as in the special case of spaces and the 
dual spaces of linear functions, we have the rule: If complementary 
bases are used in the dual spaces，then the matrix of a transformation 
A and of its transpose A f are equal. 

EXERCISE 

1. Supply proofs of statements 1), 2) and 3) above. 

5. Another relation between linear transformations and bi¬ 
linear forms. We assume again that the spaces and 9?/, i = 
1 , 2 , are dual relative to g{. Let u f and v be fixed vectors in dti 
and 0 ? 2 respectively. Then if x ranges over the mapping 

(19) x — gi{x y u’、v 

is a linear transformation of 5 Ri into 9? 2 - This is clear from the 
properties of the bilinear form. Since our transformation is de¬ 
termined by the pair u\ v y we shall denote it as the “product” 
u r X v. More generally if Ui y « 2 ’，• • •，uj are in 9 ?/ and v 2y 

• • • y v m are in 況 2 ， then the mapping u x r X X v 2 - 

+ Unl X v m is the linear transformation 

x — gi(x y Ui)vi + gi(x y u 2 r )v 2 H - h 

We show next that any linear transformation of 9 ?i into 9?2 
has this form. For let A eS(9?i ， 9 ? 2 ) and let (t^i, u 2y • • •, r r ) be a 
basis for the rank space Then if % is any vector in xA 
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can be written in one and only one way in the form 

( 20 ) xA = 01^1 02 口 2 + • • • + <t>rV r 

where the coefficients are in A. Since these coefficients are 
uniquely determined by x y we may consider them as functions of 
x y and accordingly we write <t>i = Thus (20) can be re¬ 

written as 

(20 ’） XA = + 02( 欠 )”2 + • • • + <j>r(^)v r - 

If jy is a second vector in 9^， then 

+ y)vi = (x - y)A = xA + yA — X(j>i(x)vi + 20 心 ) 

Hence + y) = + <t>i{y)- Also by (20 ’)，if a e A y then 

{ax) A = a{xA) = a(j>i(x)vi + ce </>2 + • • • + oi(j> r {x)v ry 

and this implies that = acj>i(x). Hence the functions 4>i(x) 

are linear. Since gi(x y y f ) is a non-degenerate form，it follows 
that there exist vectors u/ in 9J/ such that cj>i{x) = g\{x y u{) 
holds for all x. Thus 

= aO, ^lO^l + U 2 f )v 2 H - h gi(x y Ur)v r 

and A = Ui X + u 2 f X v 2 +• — + u r r X v r as required. 

The pairs of vectors (ui y Vx) y {u 2 r y v 2 ) y . • • ， {u m \ v m ) also define 
a linear transformation A r of 9? 2 / into dti. If x f & 況 2 ’， then we 
define 

= Uig 2 {v u x f ) + U 2 g 2 {v 2 y x f ) + • • • + u m f g 2 {v m：t x f ). 

We shall denote this transformation as 

Ui X f V! + u 2 r X f v 2 +• - + u m f X f v m - 

As is indicated by our notation the transformations A and A r 
are transposes relative to the bilinear forms and g 2 ； for if x 
is any vector in dti and x r is any vector in 9? 2 / > then 

^A f ) = giO, Z) Uig 2 {v iy x f )) = J2gi(x y Ui)g 2 {v iy x r ) 
and ' ' 

g 2 (xj y x f ) = g 2 Ui)v iy Ui)g 2 {Vi, x f ). 

Hence ^ 1 (^, x ， A’、= 〆)，and this proves our assertion. 
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We consider again the representation of the linear transforma¬ 
tion as Ui X It is clear from the definition of the product 

i 

X v that 

( 21 ) 


( 22 ) 


(ui + u 2 ’) X v = Ui X v + u 2 ; X v y 
X (^i + v 2 ) = u ; X Vi + u ; X v 2 
u f a. X y = X olv. 


Hence if we express the as = 2^/ 如 ， then X Vi = 
X Vi = Xe/ X ISjiVi = Xe/ X Wj where wj = 而 . Thus 
if we can write the “/， i = 1 ，2,…， m y in terms of fewer than m 
vectors e/ y then we can obtain expressions for A = 2 ^/ X Vi as 
a sum of fewer than m products e/ X Wj. Similarly if we can 
write the Vi as V{ = where the number off's is less than m y 

then we can obtain an expression for as a sum of less than m 
products. 

r 

Now \^t A = ^ ui X Vi be an expression for A for which r is 


minimal. Then our remarks show that the sets « ， u 2 f y … ， u r r ) 
and (viy v 2y … ， v r ) are linearly independent. Now there exist 
vectors (u ly u 2y • • • ， u r ) in dti such that 


Then 


gli^iy ^/) = Sijy iyj = 1 ， 2 ， 
UiA = X) gliMiy = Vi 


參 •參 


r. 


and [t ； i, v 2y • • • 3 v r ]Q ^StxA. On the other hand，for any x 

XA gli^y u/)Vj 8 [V ly V 2y •••，〜]• 

3 

Hence = [^i, v 2 ^ • • •， v r ] y and r is the rank of A. If we use 
the form of the transpose determined above, we see that the rank 
space ^2 A r — [ui y u 2 r , •. u/]. We remark that this gives still 

another proof of the theorem that rank A = rank A r . 

6. Scalar products. We know that, if 況 is a left vector space 
over a field 伞 ， then 況 can also be regarded as a right vector space 
over 中 . Hence we have the possibility of defining bilinear forms 
connecting 9? with itself and of regarding 況 as a dual of itself. 
These considerations can also be applied to the division ring case, 
provided that A possesses an anti-automorphism. 
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Thus suppose that A is a division ring in which there is defined 
an anti-automorphism a a. The defining properties of such 
a mapping are that it is 1-1 of A onto itself and that it satisfies 
the conditions 

(23) a + = a + = ^a. 

Thus, for example, A can be taken to be the division ring of 
Hamilton’s quaternions and a —> a the mapping of a quaternion 
onto its conjugate. We remark also that, if △= 中 is a field ， 
then an anti-automorphism is just an automorphism in ^>. Hence 
in this case a a can be taken to be any automorphism of 
In particular, we can take a = a y that is, the mapping is the 
identity automorphism. This is the classical case, and it will re¬ 
ceive special emphasis in our discussion. 

Let 9? be a (left) vector space over A. By using the given anti¬ 
automorphism a —> a it is easy to turn 況 into a right vector 
space over A. We have merely to set xa = ax y or, in other words, 
if a — is the inverse of a a y then xa = a A x. One verifies 
that this definition of right multiplication by scalars satisfies the 
basic requirement (cf. p. 6). Hence 9i becomes, in this way, a 
right vector space over A. The two dimensionalities, left and 
right, of over A are equal. In fact, it is clear that，if (e ly e 2y 
• • • ， e n ) is a left (right) basis for $K，then it is also a right (left) 
basis; for ，if x = 而 ， then x = Moreover, if 2 心心 = 0, 

then ^di A e{ = 0, 8i A = 0 and di = 0. We remark also that any 
left subspace of 況 is a right subspace and conversely. 

We can now consider bilinear forms connecting the left vector 
space 9? and the right vector space 0?. Such forms will be called 
scalar products. Thus by definition a scalar product is a function 
g(x y y) defined for pairs of vectors y) belonging to 9?, having 
values in A, and satisfying the equations 

(24) + x 2y y)=+ g(x 2y y) y g(ax y y) = ag(x y y) 

(25) +y 2 ) = g{x,y x ) + g(x y y 2 ) y g(x y ay) = g(x, y)a; 

¥ 

for since ay = ya y the second condition in (25) is equivalent to 
the second part of (6). 
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If (eiy e 2y • • •， e n ) is a basis for 況 over A, the matrix (] 8 ), = 

S^ e h e j) is called the matrix of the scalar product relative to this 
basis. Evidently this concept is a specialization of our former 
one of the matrix of a bilinear form determined by bases in the 
spaces connected by the form. As in the general case, the matrix 
and the basis completely determine the function g(x y y) ; for if 
x = and y = 2” 而 ， then by (24) and (25) 

(26) g(x y jy) = Z) 

Conversely, if (ei y e 2y ••• ， e n ) and ⑹ are given, then the equation 
can be used to define a scalar product in dt. 

We consider now the effect of a change of basis on the matrix 
of a scalar product. Let (/i ， / 2 ， … ， f n ) be a second basis of 9 ? 
and suppose that fi = 2 /x^-^y. Then if we regard these as right 
vector spaces，the relation between them is fi = 2 奶 、. where Vji 
= fiij. Thus the matrix connecting the right bases is (p)= ( 卢)’， 
and this matrix is called the conjugate transpose of the matrix 
(m)- Now we have seen (p. 139) that the new matrix of y) 
is ( 7 ) = (m ) ⑹ W. Hence we have the relation 

(27) (t) = (M ) ⑹⑻ ， 

where (/x) is the matrix that gives the change of left bases. Two 
matrices (/3) and ( 7 ) connected as in (27) by a non-singular matrix 
(m) are said to be cogredient (relative to the given anti-automor¬ 
phism). It is easy to see that this relation is an equivalence. 
The result we have established is that any two matrices of a 
scalar product are cogredient. It is also clear that, if ( 卢 ） is the 
matrix of a scalar product, then any matrix cogredient to ⑹ is 
also a matrix of the scalar product. 

If © is a subspace of 9 ?, then it is evident that the contraction 
of the function g(x y y) to the pairs of vectors in © is a scalar prod¬ 
uct for It is now natural to introduce the following notion of 
equivalence between subspaces of dt. We say that the subspaces 
@1 and @2 are g-equivalent if there exists a 1—1 linear transforma¬ 
tion of onto @ 2 such that ^(^ 1 , jyi) = g{xiU^ y\U) holds for 
all ^ 1 , yi in @ 1 . If (e ly e 2y • • •, ^ r ) is a basis for then (eiU y 
e 2 U y e r U) is a basis for © 2 ，and g(ei y ej) = g(^iU y ejU). 

Hence the matrices of the contractions of g relative to these 
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bases are identical. It follows that, if arbitrary bases are chosen 
in ^--equivalent subspaces, then the matrices determined by these 
bases are cogredient. Conversely, suppose that ©i and © 2 are 
subspaces such that the matrices of the contractions of g to these 
spaces are cogredient. Then by an appropriate choice of basis 
in © 2 we can suppose that we have a basis e 2y • • • ， e r ) for 
©1 and a basis (/i，/ 2 , • • -，/ r ) for © 2 such that g(e iy e 3 ) = g{f iy fj ). 
Now let Xi = yi — be any two vectors in We 

have hg[ei ，and this gives gOi ， Ji)= 

Now the mapping Xi = 2 匕 a • — 2 匕力 is a 1—1 
linear transformation of ©i onto © 2 - Hence the foregoing rela¬ 
tion shows that ©i and @ 2 are ^-equivalent. 

7. Hermitian scalar products. We shall assume now the anti¬ 
automorphism a —> a is involutorial in the sense that a = a for 
all a. We consider first the theory of scalar products which are 
hermitian in the sense that 

(28) g(j y x) = g(x y y) 

for all x and y. If △= 中 is a field and a = a (this is allowed), 
then the hermitian condition reads 


(29) g(y y x) = g(x y y). 

A scalar product satisfying this condition is said to be symmetric. 

If {ei y e 2y • • .， e n ) is a basis for dt over A, then the condition 
(28) implies in particular that 

Pij = g(e iy e 3 ) = g{e h e t ) = 卢 ". 

Hence a necessary condition that y) be hermitian is that the 
matrices (jS) of the scalar product be hermitian in the sense that 

( 30 ) = ⑹. 


This condition is also sufficient; for，if it holds and x = 2 匕 a. and 


y — ^rueiy then 
and 


g(y y x) = 
g{x y y) = 


Hence g(y y x) = g(x y y). In particular g(x y y) is symmetric if and 
only if its matrices are symmetric (⑹’ =(/3)). 
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If g(x y y) is hermitian, g(u y v) = 0 for the particular vectors 

u y v implies g(v y u) = g{u y v) = 0. If this holds, then we say that 
the vectors u and v are orthogonal (relative to g). Our remark 
shows that this relation is a symmetric one. If © is a subspace 
of 9 ?， we define the orthogonal complement to be the space of 
vectors v that are orthogonal to every vector w e 0 . This coin¬ 
cides with our earlier definition ofj( 0 ). It should be noted that, 
except in important special cases，some of which will be consid¬ 
ered in the next chapter，©- 1 - is not in general a complement of 
©in the lattice of subspaces. 

The subspace 況 of vectors z that are orthogonal to every 
x edt will，as before，be called the radical of g{x^ y). The scalar 
product is non-degenerate if its radical 況夂 = 0. In this case we 
know that the mapping © —> ©丄 is an anti-automorphism of 
the lattice of subspaces onto itself. Also we know that dim 
=n — dim Hence dim ©' LJ_ = dim ©. Since it is clear that 
@丄丄 2 this relation gives @丄丄 =Thus the mapping 
@ ©i determined by a non-degenerate hermitian scalar prod¬ 
uct is an involutorial mapping in the lattice of subspaces. 

A subspace © will be called isotropic if © fl ^ 0 . This 
evidently implies that © contains a non-zero vector u which 
is isotropic in the sense that g{u y u) = 0. A subspace © will be 
called totally isotropic if © C @丄. 

If g is non-degenerate and 0 is a non-isotropic subspace, then 
© 门 = 0 and dim ©丄 —n — dim ©. Hence in this case we 
have the decomposition 3 i = @® ©气 

EXERCISES 

1. Show that the existence of a hermitian scalar product 0 implies that the 
anti-automorphism a —> a is involutorial. (Hence the latter condition is super¬ 
fluous in the above discussion.) 

2. Show that the existence of a scalar product 9^0 which satisfies g(x,y) = 
g(y y x) implies that a = a and hence that A is a field. 

3. Show that, if (a) and (/3) are hermitian, then so are (a) 士 03 )， (a) r y («)(/?) + 

_• _ 

4. A scalar product h(x y y) is called skew-hermitian if h(y y x) = —h(x y y). Let 

/x be an element of A that satifies Ji — 一 /x _ 0 and let h(x,y) be skew-hermitian. 
Prove that the mapping 备一 > 专 * 三 is an involutorial anti-automorphism 

in A and that g(x y jy) = h{x y y)n is hermitian relative to this anti-automorphism. 
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8. Matrices of hermitian scalar products. In our discussion 
of hermitian scalar products we shall find it convenient to treat 
separately the symmetric forms over fields of characteristic 2 . 
We therefore assume in this section that, if g is symmetric, then 
the characteristic of A = $ is not two. 

We consider first the function g(x y x) of a single vector x de¬ 
termined by the scalar product. If g(x^y) is symmetric, the as¬ 
sociated function g(x, x) is called the quadratic form determined 
by the symmetric form. In general, we shall say that the ele¬ 
ment j8 of A is represented by the scalar product if there exists a 
vector u 9 ^ 0 such that g(u y u) = 13. Since 

u) = g(u y u) y ^ ^ 

Hence the elements represented by the scalar product are invari¬ 
ant under the anti-automorphism. An important step in proving 
the main result on hermitian scalar products is the following 

Lemma. If g(x,y) is a hermitian scalar product 9 ^ 0 , then there 
exist non-zero elements which are represented by the scalar product. 
(In other words y if is not totally isotropic，then it contains a non¬ 
isotropic vector^) 

Proof. If the conclusion is false, g{u, u) = 0 for all u. Hence 

y) + g(jy ^ + y) - 文 0 , ％) — g(j, y) = 0 

for all y. Since g(y } x) = g(x y y) this gives g{x y y )= 一文 (6 jy). 
Now since g(x y y) 9 ^ 0, there exist vectors u y v such that p = 
g(u, v) 0 . If we replace u by p~ x u and change the notation ， 
then we can suppose that g(u y y) = 1 . Then for any a in 

g(au y v) = —g{oiU y v) and a = —a. Since 1 = 1 , this implies 
that the characteristic is two and that a = a. Hence our anti¬ 
automorphism is the identity mapping and △= 中 is commuta¬ 
tive. This case is ruled out by assumption. 

The argument we have just used is not a constructive one. 
However, in the special case in which g(x y y) is symmetric, we 
can easily give such a method to find a vector u such that g(u ， u) 
9^ 0 . Thus let (eiy e 2y • • • ， e n ) be a basis for 9 ? over Then 
g{ei y ej) 9^ 0 for some pair ej. If i — j y we can take u = ei ， 
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Otherwise， we can assume that g{e^ ei) = 0 = g{e^ e 0 ) and 
g(e iy ej) 9 ^ 0 for i ^ j. Then g{ei + e Jy + e 3 ) = g{e iy e x ) + 
g(e iy ej) + g(e h e x ) + g{e h e 3 ) = g(e iy ej) + g(e jy e t ) = 2g(e iy ej) 

7 ^ 0 . 

We now return to the general case and we shall prove the fol¬ 
lowing 

Theorem 3. If g{x y y) is a hermitian scalar product，then there 
exists a basis {u^ u 2 , •••，"” z l9 z 2 ) • • •，z n _ r ) such that 

(31) g(U{ ， “ 心 = /?*•〆()，/ = 1 ， 2， • • • ， r ， 
and all other products are 0 . 

Proof. The result is trivial if ^ = 0; for then any basis serves 
as a set of z y s. If g 0 y we can take to be any vector such 
that g(ui y Ui) = Pi 9^ 0. Such vectors exist by the Lemma. 
Now suppose that we have already determined linearly inde¬ 
pendent vectors (Ui, u 2y • • •， Uk) such that g{u^ Ui) = Pi 9 ^ 0 
and g(ui y uj) = 0 if / 9 ^ j. We introduce the mapping de¬ 
fined by 

k 

(32) X -» Ui)Pi - 1 Ui. 

1 

Clearly E k is linear and maps 沉 into the space ©* = [u ly u 2y • • •， 
Uk\. Also UjEk = ^2 g(uj y u l )^i~ l Ui = Uj. Hence Ek is the iden- 

i 

tity mapping in ©*• It follows that E k 2 = E k so that，if we set 
F k = l — E ky then 9 ? = ©& ㊉ dtF k . Also we have 

g(xE ky Uj) = g(^y 

\i=l 
k 

*=1 

= g(Xy Uj). 

Hence g(xF k , uj) = g(x(l — E k ) y u 3 ) = g(x y u d ) - g(xE ky uj) = 0. 
Thus the vectors in dtFk are orthogonal to every vector in ©*， 
that is, ^ftFk Q 0 &丄. We consider the scalar product g(x y y) in 
dtF k . If this is 0 in ^tFk y we choose a basis ( 21 , z 2y …， z m ) for 
9tF k . Since 況 = ㊉況八， (u l3 u 2y • • u ky z u z 2y • • •，z w ) is a 
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Also find a non-singular matrix (jjl) such that (ji)(a)(jjL )= ⑹. 

2. Show that the space [zi, Z 2 , • • z n _ r ] given in Theorem 3 is the radical of 

y)- # # 

3. Suppose that 伞 has characteristic _ 2 and that g(x y y) is a symmetric non¬ 
degenerate scalar product in 9? over 伞 . Prove that, if g represents 0, then g is 
universal in the sense that it represents every element of 

9. Symmetric and hermitian scalar products over special divi¬ 
sion rings. The foregoing discussion reduces the problem of co- 
gredience for hermitian matrices to that of finding conditions for 
cogredience of diagonal matrices. No general solution of this 
problem is known. The known results are all special in that they 
make use of special assumptions on the nature of A and of the 
anti-automorphism. For example, a complete solution of the co¬ 
gredience problem is known for symmetric matrices over the field 
of rational numbers. The theory for this case, which is due prin¬ 
cipally to Minkowski and Hasse, is arithmetic in nature and will 


basis for 9 ?. Since the z’s are orthogonal to the us and to the z’s， 
this is a basis of the required type. On the other hand, if g 9 ^ 0 
in dtFk ，then we can find a vector Uk+i in this space such that 
g(u k+ly u k+1 ) = p k +i 9 ^ 0 . Then (u ly u 2y .. •， u k+ i) is a linearly 
independent set and, since Uk+i is orthogonal to the other 
the new set satisfies the same conditions as (u u u 2y •••， Uk)- 
The process can then be repeated. 

The method that we have given for finding a normalized basis 
is in essence due to Lagrange. It should be noted that can 
be taken to be any element that is represented by the scalar prod¬ 
uct. Also we note that any Ui can be replaced by 7 撕，〆 0. 
This replaces ft by 13/ = g(yiU iy jiUi) = yH. In carrying out 
the above process it is necessary to have a basis for dlF k . This 
can be done by supplementing (u ly u 2i • • •， Uk) to a basis (ui y 
u 2y • • •，Uky Vi y v 2y •…， v n for Then the V{Fk form a basis 
for "tRFjc ， 

EXERCISES 

1. If $ is the field of rational numbers, find a diagonal matrix (/5) cogredient to 
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not be discussed here. Instead, our plan for the remainder of 
this chapter is as follows: In this section and in § 10 we consider 
the special cases of the cogredience problem which should be 
familiar to every student of mathematics. In the last two sec¬ 
tions we consider questions which are of interest primarily to 
specialists in algebra. Thus in § 11 we consider again the gen¬ 
eral theory of hermitian forms and we discuss Witt’s important 
generalization of the notion of signature. In the final section 
(§ 12) we consider the theory of symmetric scalar products over 
a field of characteristic 2. 

We specialize first the result of the preceding section to sym¬ 
metric matrices and symmetric scalar products (△= 少 a field, 
a = a). We assume 中 has characteristic ^ 2. Suppose that 
g(x y y) is a symmetric scalar product and let u 2y u n ) 
be a basis such that 

g{u iy Uj) = dijPi y Pi 9^ 0, i = 1 ， 2， • • • ， r. 

Then r is the rank of the matrix diag {]8i, /3 2 , • • • ， j8 n } of g(x y y) y 
and r is the common rank of all the matrices of this scalar prod¬ 
uct. As we have seen, we may replace Ui by Vi = y% 9^ 0. 
Then the v J s form another basis and the matrix determined by 
this basis is 

diag {/V ， A’，• • • ， A'} 

where / = Thus we see that any can be replaced by 

13/ = yi 2 ^i y ji 5^ 0. Suppose now that $ is a field in which every 
element is a square. As usual, if y 2 = ft we write y = 0^. Then 
if 0, let ji = /3i_ H e 一 1 . This choice of yi replaces 
by P/ = 1. Hence our symmetric scalar product has a matrix of 
the form 

(33) diag {1, 1, • • • ， 1 ， 0, • • • ， 0}. 

This form is applicable in particular if 中 is an algebraically closed 
field. 

If (13) is any symmetric matrix，then (0) can be used to define 
a symmetric scalar product in 況 over 4>. The matrices of this 
scalar product constitute the cogredience class determined by ($)• 
Thus we see that, if $ is algebraically closed of characteristic 〆2, 
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then any symmetric matrix (jS) in f> n is cogredient to a matrix of 
the form (33). Clearly (33) is completely determined by the 
rank of (/3). This implies the following 

Theorem 4. If 龟 is algebraically closed of characteristic ^ 
then any two symmetric matrices in are cogredient if and only if 
they have the same rank. 

We assume next that <l> is the field of real numbers. Let the 
vectors Ui be arranged so that 

/3i > 0, i = 1 ， 2,… ， p; I3j < 0 y j = p + l y • • •, r. 

Then we can extract a square root of (3i y i < p and of — 
r > j > p. Accordingly, let ji = Pi— Y2 ， 7j= ( — &)-%• Using 
these ji as above, we obtain a matrix 

<~ P —. r—r - p 

(34) {1，.'l，-1， …， -1,0, •••，()}* 

for g(x, y). It follows from this that any real symmetric matrix 
is cogredient to a matrix of the form (34). We shall show next 
that two matrices of the form (34) cannot be cogredient in ^> n , 
中 the real field，unless they are identical. This will follow from 

Theorem 5 (Sylvester). If the diagonal matrices 

{卢1，々2， • • •， fti }， 戸2 ’，•••， ft /} 

are cogredient in ^ ny $ the field of real numbers, then the number p 
of positive pi is the same as the number p f of positive j8/. 

Proof. The given matrices may be taken to be matrices of the 
same symmetric scalar product in 9? over 少. We may suppose that 
the first p Pi are > 0 and the first p r jS/ are > 0 and that in both 
matrices the first r elements are 9^ 0 and the last n — r are 0. 
Let (uiy u 2y • . u n ) be a basis relative to which the matrix of 
g(x y y) is {/5i, /? 2 ，• • •， Pn) and (^i, v 2i • • v n ) a basis for which 
the matrix is {〜’， /3 2 \ • • •，It is easy to see (Ex. 2, p. 154) 
that the radical 

況丄 = ["r + l ， "r+2，. • “w] = [^r+ lj +2> • • • ， 口 n]. 

* In the remainder of this chapter we drop the symbol “diag” in the notation for diag¬ 
onal matrices. 
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We now introduce the following subspaces : 

沉 + = [U\y u 2y •••，％] 

©+ = [v u V 2 y … ， V] 

況一一 ["p + 1 ， "p+2，* * * 3 ^r] 

©- = [v+1 ， V+2，•••，〜]• 

p n 

Let jy e 9? + + 5R X . Then y = ^2 Vi u i ~i~ S Vj u j an d 

1 r+l 

P 

g(yy y) = JL Vi 2 Pi- 

i 

Since ft > 0 for i = 1, 2 y • • •, p y g(y y j) > 0 and g(y, y) = 0 
only if all the rji = 0 y i < p. Thus if j e 9i + + 況丄， g(y y jy) > 0 
and g(y y y) = 0 only if y e 沉气 A similar result holds for ©+ 
+ 況丄 • On the other hand，if jy e 況_ + 沉丄 or to ©— + 況丄， then 
a similar argument shows that g{y y y) < 0 and that g{y y y) = 0 
only if j e 況丄 . Now let y z (9i + + 況丄） fl (©— + 沉 丄 ). Then 
g(jy y) >0 and g(y y y) < 0. Hence g(y y y) = 0 and y 8 9? x . 
This establishes the following relation : 

(35) (況 + + 沉丄）门 （©— +況丄）=況夂 

We now make use of the general dimensionality relation (Ex. 3, 

p. 28): 

dim (©i fl @2) = dim ©i + dim © 2 — dim (©i + @ 2 ) 

> dim ©i + dim © 2 一衫. 

Applying this to (35) we obtain 

n—r>p-jr(n — — p f ) + (w — r) 一 

Hence p — <0. Similarly p f < p and so p = p’• 

Sylvester’s theorem shows that the number of positive elements 
in any diagonal matrix that is cogredient to a given real sym¬ 
metric matrix (/3) is an invariant. Likewise the difference 2p — r 
between the number of positive elements and the number of neg- 
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ative elements in any diagonal form is an invariant. We call this 
number the signature {inertial index) of the matrix. The main 
theorem on real symmetric matrices may now be stated as 

Theorem 6. Two real symmetric matrices are cogredient if and 
only if they have the same rank and the same signature. 

We assume next that 中 is the field of complex numbers and that 
a —> a is the mapping of a complex number into its complex 
conjugate. Let g{x y y) be a hermitian scalar product in 9? over $ 

associated with the usual mapping a a. For any u y g(u y u )= 
g(u y u) is real. In particular，if (u u u 2y • • •， u n ) is a basis such 
that (31) holds，then the elements 氏 are real. If we replace Ui 
by Vi = yiUi y ji ^ 0, then ft is replaced by = | yi It 

follows in this case，too, that 9? has a basis relative to which the 
matrix has the form (34). 

Sylvester’s theorem holds in the present case also. It asserts 
that，if $ is the complex field and {^ ly I3 2) •••，&} and (/3 / y /V， 
• • •， ^n} are cogredient in the sense that there exists a matrix 
(/x) in L% n) such that 

{戸1’， 戸 2’，•••，/V} = (M){01， 02, • • /3 n }(/2 )’， 

then the number of positive ^ is the same as the number of posi¬ 
tive 13/. The proof is exactly the same as before. The essential 
point is that, if 

p n 

y = Yj Vi^i + S Vj 以 j 

i r+1 

and > 0 for i < p and /3j = 0 for j > r y then 

siy^y) = s l Vi \ 2 ^i > o. 

As in the real case we have the criterion that two hermitian 
matrices are cogredient relative to the anti-automorphism a —» a 
if and only if they have the same rank and the same signature. 
Here again we define the signature to be the difference between 
the number of positive elements and the number of negative ele¬ 
ments in a diagonal matrix cogredient to the given hermitian 
matrix. 
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We consider finally the theory of quaternionic hermitian forms. 
Let A be the division ring of Hamilton's quaternions and let 
a ： a be the mapping of a quaternion a = a 0 + a\i + a 2 j + 
a^k into its conjugate 

a = ao — a\i — o^j — a^k. 

If g(x y y) is hermitian in dt over A, g(u y u) = g(u y u) is real. 
Also aa = a 0 2 + a：i 2 + a 2 2 + as 2 > 0 and equality holds only if 
a = 0. These remarks indicate that this case is essentially the 
same as the complex hermitian case. Matrices of the form (34) 
serve as canonical forms under cogredience. Sylvester’s theorem 
and the final result that equality of ranks and of signatures are 
necessary and sufficient conditions for cogredience hold. 


EXERCISES 

1. Prove that the number of cogredience classes of real symmetric matrices of 
n rows and columns is (n + l)(w + 2)/2. 

2. Find a matrix of the form (34) cogredient to the real symmetric matrix 

_ 1 3 -5^ 

3-1 0 • 

.一 5 0 2. 


3. Find the matrix of the form (34) that is cogredient to the hermitian quater¬ 
nion matrix 


•一 1 1 + / - 2j -2i + k' 

1 - / + 0 4j 

-2 / 一 k 一 4 2 - 


4. Prove that, if (a) y ⑹， .• • ， » are a) real symmetric, or b) complex hermitian, 
or c) quaternionic hermitian, then 

(a) 2 + 03) 2 + … + ⑻ 2 = 0 

can hold only if (a) = (j3 )= … = ⑻ = 0. 


10. Alternate scalar products. A scalar product g(x y y) is called 
skew symmetric if gix^y) = —g(jy y x) for all x and y. In this 
case g(x y x) = —g(x y x). If the characteristic is not two，then 
this implies that g(x y x) = 0. If the characteristic is two, it 
may still be true that g(x y x) = 0 for all x. We shall now call 
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a skew symmetric scalar product alternate if g(x y x) = 0 for all 
and we consider the problem of finding suitable canonical 
bases for this type of scalar product. The proof of the lemma on 
p. 152 shows that, if g(x,y) is alternate，then it is skew symmetric 
and that, if* g 〆 0 is skew-symmetric, then a = a and △= 中 
is commutative. 

Suppose that g(x y y) is alternate and not identically 0. Then 
we can find a pair of vectors u y v such that g(u y v) 9 ^ 0. By re¬ 
placing t; by a suitable multiple Vi of v we then obtain = u 
and Vi such that g{u u 〜） =1. Then g{v u Ui) = — 1 ， g(u ly 
= 0 = g(vi^ Vi). It follows that 以 i and Vi are linearly independ¬ 
ent. Now suppose that we have already found k pairs of vectors 
UiyVi y u 2y V 2 y * * *, UkyVk that are linearly independent and satisfy 

(36) g{u h Vi) = 1, g{v iy Ui) = 一 1 

with all other products 0. Let Ek denote the linear transforma¬ 
tion 

k k 

(37) v i) u i — 


As in the proof of Theorem 3 we see that Ek is a projection on 
the space ©* = [u u v u u 2 ^ 2y . • Hence if F k = 1 — E ky 

況 =©a ； ㊉ ^ftF k . Also we can verify that g(xE k3 = g(x y 
and g(xE ky Vi) = g(x y Vi). Hence g(xF k , u % ) = 0 = g(xF ky Vi) and 
dtFjc Q ©a ； 丄 •* Now either ^ is 0 in dtFk or we can choose a pair 
of vectors Uk+u ^+i in this space such that 


g{u k+u Vic^i) = 1 = —^(^+ 1 , Uk+i)- 

Since ©a ； fi dtF k = 0, {u u vi y u 2 ， v 2i •. • ， u k+u VTc + i) is an independ¬ 
ent set and since the last two vectors are orthogonal to the pre¬ 
ceding ones the set of 2(k + 1) vectors satisfies the same condi¬ 
tions as the set (ui y v^ " 2 , 口 2 ， ••• ， u^vu). Eventually we either 
span the whole space or obtain a space dlF r in which g is 0. In 
the latter case we choose any basis {z 2r +u •••，〜）for this space. 

• ©/is the orthogonal complement of defined as for hermirian scalar products. 
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Evidently the matrix of y) relative to the basis 


is 


(38) 


從 2, 口 2， • • • ， 從 r’”r ， ^ly^2y • • • j 之 n — 2r) 



This proves the following 



Theorem 7. If g(x y y) is an alternate scalar product) there exists 
a basis for 3? relative to which the matrix has the form (38). 

If g(x y y) ¥ 0 is alternate, the anti-automorphism is the identity 
and the matrices (/?) of g(x y y) are alternate in the sense that 
(/3)’ = 一 （ /3) and /3u = 0 for i = 1 ，2 ， •••，”• These conditions 
are also sufficient; for if ^ = 2 匕 a 、then 

S( X > %) = + S + = 0- 

• • • • ^ • 

itJ % *<J 

Hence g(x y y) is alternate. The following results are now easy 
consequences of Theorem 7. 

Corollary 1 . The rank of an alternate matrix with elements in a 
field is even. 

Corollary 2. Two alternate matrices in are cogredient if and 
only if they have the same rank. 
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1. Prove that 


EXERCISE 



- 0 

2 

一 1 

3. 


- 0 

1 

0 

0 - 

-2 

0 

4 

-2 

， 05 ) = 

-1 

0 

0 

0 

1 

—4 

0 

1 

0 

0 

0 

1 

.-3 

2 

-1 

0 . 


. 0 

0 

一 1 

0 - 


are cogredient in 中 4 , 中 the field of rational numbers. Also find a (jjl) in L ( 中， 4) 
such that (/3) = • 

★11. Witt’s theorem. We now take up again the general 
theory of hermitian scalar products over a division ring. In the 
present discussion we shall assume that the basic anti-automor¬ 
phism a a satisfies the following solvability condition. 


Axiom S. The equation 套 + | = ^ has a solution for every her- 
mitian element ^ of the division ring. 

This axiom is automatically satisfied if the characteristic of A 
is not two; for，in this case, we may take ^ It is also satis¬ 

fied in the characteristic two case if there exists an element 7 
of the center r of A such that 7 ^ 7 . Then 6 = 7 + 77^0 is 
in T since the anti-automorphism maps T into itself. Hence if 
f then 


专 + I = - 1 + 5 _1 = /3S~ 1 (y + 7 ) = /?. 

We remark finally that our axiom rules out the case △ =宄 a 
field of characteristic two, a = ce. This is clear since in this case 
专 + I = 0 while 13 need not be 0 . 

Assume that 9? is a vector space over A and that g{x y y) is a 
non-degenerate hermitian scalar product relative to the anti-auto¬ 
morphism a. We recall that, if © is a subspace of 況 that is not 
isotropic in the sense that @ fl ©- 1 - = 0 , then we have the de¬ 
composition 9 ? = @ ㊉ @气 The basic result of the theory which 
we shall develop is the following theorem. 


Witt’s theorem. If ©1 and © 2 are non-isotropic and g-equiva- 
lent y then and © 2 丄 are g-equivalent ， 

* Witt proved this result for symmetric scalar products over a field of characteristic 
9^ 2 {Journalfur Math” Vol. 176 (1937)). The extension to division rings of characteristic 
〆 2 is due to Pall {Bulletin Amer. Math. Soc” Vol. 51 (1945)). In the present discussion 
we assume only the foregoing Axiom S. Cf. also Kaplansky, Forms in infinite dimensional 
spaces 、 Anais Acad. Brasil Ci. 22 (1950) ， pp. 1-7. Witt’s theorem does not hold for sym¬ 
metric scalar products over a field of characteristic 2 (see the next section). 
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Proof. It suffices to prove the result for dim @1 = 1 ； for, if it 
is known in this case, then we can use induction on dim as 
follows. We choose a vector Ui in ©i such that [ui] is not iso¬ 
tropic (Lemma to Theorem 3). Then ©i = [ui] ® Ui where 
Ui C Using the equivalence of @i and 0 2 j we can write 

@ 2 = [^ 2 ] ® U 2 where U 2 Q [« 2 ]丄， [以 i] and [u 2 ] are equivalent and 
Ui and U 2 are equivalent. Then [Mi] 丄 =Ui © ©1 丄 and [" 2 ]丄 = 
Vi 2 © © 2 丄 are equivalent under a transformation U. Hence 
[以 2 ] 丄 =U 2 ㊉ © 2 X = UiCZ ㊉ ％ 丄? 7. Now U 2 and VnU are equiva¬ 
lent and UiU and ©/C/ are orthogonal. Since dim Ui?7 < 
dim @1 and Ui is not isotropic, we can assume that @ 1 丄[/ and @ 2 ± 
are equivalent. This implies that and ( S> 2 ± are equivalent. 

We note next that the case: ©1 = [ui] y dim 沉 arbitrary, can 
be deduced from the special case: ©1 = [^i ] 3 dim 9i = 2 . Thus, 
suppose we know the result in the special case. Let © 2 = [^ 2 ] 
be equivalent to [ui]. We have the decompositions 9?= =[“ 1 ] ㊉ 
[" 1 ]丄 = [以 2 ]㊉ [" 2 ] 丄 and g(u Xy Ui) = g{u 2y u 2 ). If \u ly u 2 ] is one¬ 
dimensional, [以 1 ]丄 = [以 2 ] 丄， and the theorem holds. Hence as¬ 
sume that dim \u\ y u 2 ] = 2. Consider first the case in which 
this space is not isotropic. Here 

沉 ==[“ 1 ， 從 2 ]㊉ [“ 1 ，“ 2 ]i 

(39) = [“ 1 ] ㊉ （[“ 1 ，“ 2 ] A [“ 1 ] 丄 )㊉ [“ 1 ，“ 2 ] 丄 

= [“2] ㊉ （[“1，“2] A [“2] 丄) ㊉ [“1， “2]丄. 

Then [ui y U 2 ] H [« 1 ]丄 and [«i, 以 2 ]门[以 2 ]丄 are equivalent by the 
case dim 9 ? = 2 (applied to 9 i = [u ly u 2 ])- Hence by (39) 

[«1]丄 =([“1，“2] n [“ 1 ] 丄) ㊉ [“ 1 ，“ 2 ] 丄 

and 

[«2] 丄 = ([u U U 2 ] fl [«2] 丄 ) ㊉ |>1 ， 《 2 ] 丄 

are ^-equivalent. Next consider the case in which [ui y u 2 ] is iso¬ 
tropic. Here we have a vector w 9^ 0 in this space such that 
g(w } Ui) = 0 = g(w y u 2 ). We can find a / in 況 such that g(w y t) 
9^ 0 . Then the matrix of g in [ui y u 2y t] relative to the basis 
(w y u ly t) is 

0 0 g(w y t )' 

0 g{u u Ui) * • 

g{t> w) * * 
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+ Ml2iSlMl2 = OL 

Mll«M21 + Ml2i8lM22 = 0 = M21«Mll + M22^lMl2 
M21〜21 + M22^l/^22 = ^ 2 * 

0 y 1 x 22 = 0 by (42) since M 12 〆 0. Hence a = 1 ^ 12 ^ 1^12 


It is evident that the row vectors of this matrix are linearly 
independent; hence the matrix is non-singular and [u iy u 2y t] is 
not isotropic. Hence 

況 == [從 1， ,] ㊉ [“1， “2， ,] 丄 

=[以1] ㊉ （[以 1，“2, /] A [從 1] 丄) ㊉ [從 1，“2, /]"*" 

= ["2] ㊉ （["1，"2, /] n [" 2 ] 丄） ㊉ ["1，以2, /] 丄. 

Thus, it suffices to show that [u ly u 2y /] H [u^\ L and [u ly a 2 , /] fl 
[u^[ L are equivalent. Now these are non-isotropic two-dimen¬ 
sional spaces that contain an isotropic one-dimensional subspace 
[w]. In a space of this type we can always select a basis relative 

「0 ll . 

To see this, choose q so that 


to which the matrix is 


1 0 


g(w y q) = \ = g{q y w) and set z = q + \w. Then g(z y w) — l 
= g(w y z) also while g(z y z) = g(q y q) + X By Axiom S we 

can choose 入 so that g(z y z) = 0. This gives a matrix of the re¬ 
quired form. It follows now that [u u u 2y t] fl [u^ 1 - and [u iy u 2 ^ /] 
fl [從 2 ]丄 are equivalent. This completes the reduction to the 
case: dim dt = 2 y dim @1 = 1. 

We consider finally this special case. The result we wish to 
prove here is equivalent to the statement that, if the non-singu¬ 
lar diagonal hermitian matrices { a^i } and {a y ^ 2 } are cogredient， 
then the elements and /3 2 are cogredient. Let (ju) be a non¬ 
singular matrix such that 


(40) 


If A is commutative, we take determinants and we obtain 
=where jx = det (/x r -y), which is the desired result. In the 
general case we shall work directly with the conditions that are 
given by the matrix relation. These are 


Mil M 12 


~a 0 


fill M 21 


a O' 

-M 21 M 22 - 


-0 ^ 


Ml2 M22 - 


九 


\lf / 


M 


\)/ \)/ 

2 3 

4 4 4 rr 

/(\ /(\ >\ X 




__ BILINEAR FORMS _165 

and /?2 = M 2 i«M 2 i. These relations imply that jSi and /5 2 are co- 
gredient. 

Assume, therefore, that Mu _ 0. Then by (42) 

0 ^ 21 = 一 Mll_Vl2 灿 22 

M21 = 一 M22 々 l 兵 12 卢 11 一 1 a 一 1 

so that by (43) 

M22( 々 l 分 12011 — L 一 Vll 一 Vl20l + ^l)M22 = ^2- 

Thus j 8 2 is cogredient to ^i/ 2 i 2 / 2 u'' 1 a~Vii~'Vi 2 ^i + We 

wish to show that the latter element is cogredient to For 

this purpose we try to solve 

(44) (1 + 0l/^12?Ml2)/5l(l + 卢 12 !Ml 2 々 l) 

= 卢 1 卢 12 只 11— ^ 一 Vll—Vl2 卢 1 + ]8l. 

This will be satisfied if 

(45) ? + I + ?Ml 2 ^lMl 2 l = (MllQ^ll)- 1 . 

Replacing /xi 2 j 8 iMi 2 according to (41) we obtain 

(46) ? + ! + ?(« — Mii«Mu)l = (mu^Mu) -1 . 

If Mil = (46) reduces to J + I = 一 S which is solva¬ 

ble by Axiom S. If /xn 〆 1， we make the substitution g = rj 一 1 
and multiply on the left by rj and on the right by ^ to obtain 

(47) v + V + (oi — Mii^/Iii) = v(miio^ii) 一 1 々 • 

Next we substitute 77 = f + M 11 喊 11 and obtain 

(48) = a. 

Now (48) is satisfied by f = — a/ 2 n ； hence (47) is satisfied by 
rj = (M 11 — l)«Mn which is not 0. Then 专 =?；— 1 satisfies (46). 
Thus (44) holds and Pi and /5 2 are cogredient. This completes 
the proof. 

A 1-1 linear transformation U of 31 onto itself is said to be 
g-unitary if g(xU y yU) = g(x y y) holds for every pair of vectors 
x y y in dt. Evidently this condition is equivalent to the require¬ 
ment that TJU f = 1 where U f is the transpose of U relative to the 
scalar product. Now suppose again that ©1 and © 2 are non-iso¬ 
tropic spaces which are ^-equivalent and let M be a ^-equivalence 


166 


BILINEAR FORMS 


of ©i onto © 2 . By Witt’s theorem we can find an equivalence 
TV of ©i -1 onto @ 2 气 Since 況 =©i ㊉ © 1 丄 ， any vector x can be 
written in one and only one way as u + v where u e^>i and 
v e © 1 气 Then the mapping U' x — uM + vN is a 1-1 linear 
transformation of dt onto itself. Moreover, making use of the 
fact that uM e © 2 and vN 8 © 2 ' L 3 we can verify directly that U is 
^■-unitary. Evidently U coincides with the given equivalence M 
on the subspace @i. Thus we see that Witt’s theorem implies 
that any ^-equivalence between non-isotropic subspaces can be 
extended to a ^-unitary transformation. We shall now show that 
this result holds also for isotropic subspaces of SR. 

Consider first an arbitrary subspace @ of 9?. If x is any vec¬ 
tor in 9?, then the mapping y g x (j) = g{y^ of @ into A is 
a linear function. It is easy to see that the linear functions thus 
obtained fill up the conjugate space ©* of © (Ex. 2 y p. 56). 
Hence if (ju J 2 ，. • ym) is any basis for ©，then we can find a 
vector Vi such that 

(49) g(j ly v t ) = 1, g(j iy vx) = 0 for i > 1. 

Assume now that @ is isotropic and that (yi y y 2y … ， y v ) is a 
basis for the radical of ©. Then we can choose the vector so 
that in addition to (49) we have 咖 1 ， ^i) = 0. This can be seen 
by an argument used in the proof of Witt’s theorem. Thus if 
Vi is not orthogonal to itself, then we can replace this vector by 
Vi + XjVi and choose X so that 入 + X + ^(^ 1 , ^i) = 0. We then 
denote this new vector as Vi ， 

Now the space \ji y Vi] is a two-dimensional non-isotropic sub¬ 
space of Hence 9? = [yi ， h] ㊉ \ji y Pi] 丄 . Also it is clear that 
\j 2 y • • • ， JVtJ £ [yiy 。 1 ]丄 and that [y 2y • • •，>] is the radical of 
[y 2> - - •,jy m ]. Hence we can use induction on v to prove the exist¬ 
ence of a set of vectors (vi y v 2y •••，％) such that 

g(jh ^*) = l i = 1， 2 , …， p 

(50) v i) = 0 otherwise 

v k ) = 0 乂是 = 1 ， 2, • • L 

It is immediate that the vectors (^i, v 2y •••，％) are linearly inde¬ 
pendent and that the space 93 = [vi y v 2y is totally isotropic 
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and satisfies 33 fl @ = 0. The matrix of ^ in @ + 33 relative to 
the basis (y u y 2 y - - - , v 2y •• - y v v ) is 



0 

0 

_ 

1 

• 

• 

• 

1 

(51) 

0 

B 

0 


1 




• 

• 

參 

0 

0 


1 




where B is the matrix relative to (j v +u •••， y m )- Since [y u 
…， is the radical of ©, B is non-singular. Hence (51) is non¬ 
singular and so @ + 95 is not isotropic. 

Now let U be an equivalence of © (onto ©C7). Evidently 
[yiUy • • •, y v U] is the radical of ©[/• Hence we can find a set 
of vectors (vi y v 2y •••，&) such that 

g(jjU y vj) = 1, j = 1, 2, -- y v 

g(jiU y Vj) = 0 otherwise 

h) = 0 ， j ， 是 = 1 ， 2, • • •，l 

Then it is clear that the linear transformation that sends Vj into 
Vj and that coincides with C/ on © is an equivalence of © + 9S. 
Since © + S3 is not isotropic，this mapping can be extended to a 
^-unitary transformation. Hence we have proved the following 

Theorem 8. Any g-equivalence of a subspace of dt can be ex¬ 
tended to a g-unitary transformation in 況 •* 

A hermitian scalar product is called totally regular if x) 
〆 0 for every x 9 ^ 0 in dt. This is equivalent to saying that 
every non-zero subspace of 況 is not isotropic. Hence if g is 

• Cf. Dieudonn6, Sur les Groupes Ciassiques, p. 18. 
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totally regular and © is any subspace，then dt = ©㊉ © 丄 . We 
shall now show that the problem of cogredience of hermitian 
matrices can be reduced to the case in which the associated scalar 
products are totally regular. 

Let © be a totally isotropic subspace of 9? which is maximal 
in the sense that it cannot be imbedded in a larger subspace of 
this type. Write @ = [y^ • • •, jyJ where the yi are linearly in¬ 
dependent. As before we determine a totally isotropic space 
S3 = [viy •••，％] such that 36 = © + 33 = © ㊉ 93 and such that 
the matrix of g relative to the basis (ji y • • ^ y vy v ly • • •, v v ) of 
X is 

- 1 
0 •• 

1 

(52) - • 

1 

•- 0 


Since @ is a maximal totally isotropic subspace and 況 =© ㊉ 93 ㊉ 
g is totally regular in 王气 We can choose a basis for 況 so that 
the matrix of g has the form 


(53) 


0 


1 


0 


0 0 


0 0 


B 
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where 5 is a matrix of g in X 1 . Thus any hermitian matrix is co- 
gredient to one of the form (53) in which B is totally regular 
(that is, the associated scalar product is totally regular). 

Conversely suppose that we have any matrix of g of the form 
(53) where B is totally regular. Let (ji y • • y vy • • •, v vy 
• • • ， z n _ 2 „) be a basis such that the matrix of g relative to 
this basis is the given matrix (53). Then © = \ji y • • • y y v ] is 
totally isotropic. Moreover, © is maximal totally isotropic; for ， 
if there is a larger totally isotropic subspace containing then 
it contains a non-zero vector of the form v z where v e [t ； i, 
•••，％] and z e [z u • • •，Then g(v + 2 , v + z) = g{z y z) 
= 0 so that z = 0 . \i v = 27 ^^ g{v y yi) = yi ， Hence also 
v = 0 contrary to v -j- z 9 ^ 0 . 

We are now in a position to show that two matrices of the form 
(53) in which the B y s are totally regular are cogredient if and 
only if the matrices B are cogredient. The “if” part is, of course ， 
trivial, and the foregoing discussion shows that the “only if” 
part is equivalent to the statement that the spaces 王 丄 deter¬ 
mined as above by a maximal totally isotropic subspace @ are 
^-equivalent. 

We observe first that any two maximal totally isotropic sub¬ 
spaces have the same dimensionality. Thus let ©1 and @ 2 be 
of this type and assume that dim @1 > dim © 2 - Then we can 
find a subspace Ui of @1 such that dim Hi = dim © 2 - Since Ui 
and @2 are totally isotropic，any 1-1 linear transformation of 
Ui onto © 2 is a ^--equivalence; hence it can be extended to a uni¬ 
tary transformation U. Then ©if7 is totally isotropic and con¬ 
tains XhU = @ 2 . By the maximality of @ 2 this implies that Ui 
=©1 and that dim = dim © 2 - 

Now let ©i = [yi ⑴， • • •， i = 1 ，2 ， and determine 33^ = 
bi (i 〉，• • •，^ (i) ] as above so that the matrix of g in Hi = + SS* 

is (52). Then h and 3£ 2 are ^-equivalent; hence also 王 / and 知丄 
are ^-equivalent. We have therefore established the following 

Theorem 9. Any non-singular hermitian matrix is cogredient 
to one of the form (53) in which B is totally regular、two matrices 
of the form (53) in which B is totally regular are cogredient if and 
only if the submatrices B are cogredient. 
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The number of rows and columns of the matrix B is, of course, 
an invariant of the cogredience class. This number is the di¬ 
mensionality of the spaces X 1 and is also n — 2v where v is the 
maximum dimensionality of totally isotropic subspaces relative 
to g. We shall call this non-negative integer the Witt signature 
of g or of the associated matrices. It can be seen (Ex. 1 below) 
that for symmetric matrices over the real field or for hermitian 
matrices over the complex field or over real quaternions the Witt 
signature is the absolute value of the ordinary signature which 
we defined before. 

EXERCISES 

1. Prove the foregoing statement on signatures. 

2. If g is an alternate non-degenerate scalar product, a 1-1 linear transforma¬ 
tion 6* of 5R such that = gi^.y) is called a symplectic transformation. 

Prove the following analogue of Theorem 8: Any g-equivalence of a subspace of 
9? can be extended to a symplectic transformation. 

★12. Non-altemate skew-symmetric forms. We suppose finally 
that g(x, y) is a skew symmetric scalar product that is not alter¬ 
nate. Then $ has characteristic two and g{x^ y) may also be re¬ 
garded as symmetric. Moreover, we have seen that, if {e u e 2 , 
• • • y e n ) is a basis for 5K, then g{e^ ei) ^ 0 for some /• We shall 
now show that it is possible to choose a basis (ui y u 2 , • • • ， u ry 

z 2y • • •， z n _ r ) for 3i such that the matrix determined by this 

basis is , 、 

{ 戸 1 ， 02， • • • ，尽 r ， 0, 0， - - 0} 3 

9 ^ 0, Evidently Ui can be chosen so that ("i ， u{) = 仏 〆 0. 
Now suppose that u iy u 2y • • Uk have already been found such 
that g(ui y Uj) — Sij/3iy Pi 9^ 0. As in the proof of Theorem 3 we 
can write 9? = ©a ； ㊉ dtF k where @/b = [ui y u 2y • • • ， 以无 ] and dtF k 
C ©fc- 1 . If g(x y y) is identically 0 in dtFk y we set k = r and choose 
a basis (z ly z 2y • • • ， z n _ r ) in dtF k . If g(x y y) is not alternate in 
dtFky then we choose a vector Uk+i in this subspace so that 
g(uk+iy Uk + i) = 7^ 0. We then repeat the argument with 

the k \ us. It remains to consider now the case in which 
g(x y y) is not identically 0 and alternate in dtFk- Here we can 
find two linearly independent vectors v y w such that 

(v y v) = 0 = (Wy w)y (V, W) = I = (Wy V). 
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We now set u = Uk y P = Pk and we consider the scalar product 
in the three-dimensional space [u^ v y w]. Using these vectors as 
basis we obtain the matrix 

■)8 0 0 
0 0 1- 
.0 10 . 

Thus if j + rjv + a.ndy f = + r] f v + then g(j y y f ) 

=Hence the following vectors 

y± = u + v 

y2 — u ⑽ 

ys = u + v + I3w 

are orthogonal in pairs and satisfy g(ji y yd = It follows that ， 
if we replace the original by yi and call this vector Uk again, 
then u u ••• ，《 * ， u k+1 = y 2y u k+2 = yz satisfy g(u iy Uj )= 
Pi 0. This proves 

Theorem 10. If $ has characteristic two and g(x,y) is a non¬ 
alternate symmetric scalar product in 9? over 龟 y then there exists a 
basis of dt relative to which the matrix of g(x y y) is a diagonal 
matrix ， 

The argument used in the proof of the preceding theorem shows 
that the matrices. 

1 0 0] [10 0 

0 0 1， 0 10 

.0 1 0J [0 0 1. 

are cogredient. On the other hand these submatrices 

0 11 [10 

1 0J ， 10 1 

are not cogredient. These observations show that Witt’s theo¬ 
rem does not hold in the characteristic two case. 

* The canonical form given in this theorem is useful in that it simplifies matrix calcula¬ 
tions with symmetric matrices over a field of characteristic two. A more geometric dis¬ 
cussion of symmetric scalar products in the characteristic two case has been indicated by 
Dieudonn6, Sur les Groupes ClassiqueSi p. 62. 
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As we have pointed out at the beginning of these Lectures, 
Euclidean geometry is concerned with the study of a real vector 

n 

space relative to the scalar product ^2 hi determined by writ- 

l 

ing x = y = 'ErjiUi in terms of basic unit vectors that are 

mutually orthogonal. Since this scalar product is fixed, it is cus - 
tom ary to denote it simply as (x y y) instead of g{x^y) as in the 
preceding chapter. The geometric meaning of {x y y) is clear. It 
gives the product of the cosine of the angle between x and y by 
the lengths of the two vectors. The length of x can also be ex¬ 
pressed in terms of the scalar product，namely, | % | = (%， x) 1A . 

From our point of view the characteristic properties of (x 3 y) 
can be stated by saying that this function is positive definite in 
the sense that (x y x) > 0 for all x 7 ^ 0. In fact, it is customary 
nowadays to axiomatize Euclidean geometry in the following 
way. We suppose SR is a finite dimensional vector space over the 
field of real numbers, and we take in SR a positive definite sym¬ 
metric scalar product (x y y). The space 況 over 中， together with 
the fundamental scalar product, constitutes a Euclidean space. In 
a similar manner we define the complex analogue of a Euclidean 
space as a vector space over the field of complex numbers to¬ 
gether with a positive definite hermitian scalar product defined 
in this space. In this chapter we shall study properties of these 
spaces and of certain special types of linear transformations in 
these spaces. We shall also consider briefly the theory of analytic 

functions of matrices (or linear transformations). 
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1. Cartesian bases. Let 9? be a Euclidean space in the sense 
that 況 is an ^-dimensional vector space over the field of real 
numbers in which a positive definite symmetric scalar product 
(x y y) is defined. Thus the basic properties of this real valued 
function are 

(1) (^i + x 2y y) = (^i, y) + y) y 

Ji + J 2 ) = Cv ， jyi) + (x y y 2 ) 

(2) {otx^y) = a(x y jy) = (x y ay) 

⑶ ( a ;, y) = (j y x) 

(4) x) > 0 if x 9 ^ 0. 

Now we know that，if (x y y) is any symmetric scalar product in 
a real vector space, then there exists a basis (ui y u 2y …， u n ) 
such that {uiy Uj) = where the /3» are either 1， _1，or 0. If 
(x y y) is positive definite, clearly every /?*• = 1. Thus we see that 
there exists a basis (u u u 2y • • •， u n ) for 9? such that 

( 5 ) (U iy Uj) = dij. 

Then if y = 

(■v ， jy) = 

as usual, 

A basis which satisfies (5) will now be called a Cartesian basis 
for the Euclidean space. The method of Lagrange for determin¬ 
ing such a basis is capable of some refinements which we now in¬ 
dicate. Let (eiy e 2y • •. ， e n ) be any basis for 9?. Then (ei 3 ei) > 0. 
Hence if u x — e^) ~ V2 e^ (ui y Ui) = 1. We next apply La¬ 

grange^ reduction and set 

/2 = ^2 ~ (^2y U\)U\. 

Then (/ 2 ， u{) = (e 2y Ui) — (e 2y Ui)(ui y Ui) = 0. Hence Ui and 
u 2 = (/ 2 , J 2 ) ~ y i 2 satisfy 


U \) = 1 = (" 2 ，“2)， （"1，"2) = 0 = (" 2 ，“1). 
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Suppose now that {u u u 2y •••， Uk) have already been deter¬ 
mined so that (uiy Uj) = Sij and [u\ y u 2 , •••，〜] =[G ， G，• • • ， G] 
for t < k. Let 


fk+l = A + l — （G + l ， U\)ui — (Ofc+ 1 ， u 2 )u 2 — ••— (^k + ly Ujc)Uk» 

Then (fk+i y Ui) = 0 for i = 1, 2, ••• ，々 • Hence if we set u k +i 
= {fk+u fk+i)~ V2 fk+u then (u u u 2 , • • •， u k+1 ) satisfy the condi¬ 
tion stated for {u u u 2y …， u^). Repetition of this method leads 
at length to a Cartesian basis for 9?. The process we have given 
for “orthogonalizing” the basis (e ly e 2y •…， e n ) is often called 
E. Schmidt’s orthogonalization process. 

It is worth noting that the matrix of (u ly u 2y • • • ， u n ) relative 
to (e ly e 2y •••， e n ) is triangular; for [u u u 2y • • u { ] = [e u e 2y 

ei\. Hence Ui is a linear combination of the ej with j < i. 

i 

Thus Ui = Tijej y and the matrix of the us relative to the e s is 


⑹ 


Til 

T 21 T22 


(T) = • 


lr nl 


Tn2 


0 


nn J 


If (13) is the matrix of (x y y) relative to the originally chosen 
basis (eiy e 2y ••• ， e n ) y then we know that the matrix of («i, u 2y 
… ， u n ) is (r) (jS) (r) 7 . On the other hand，by (5) the latter matrix 
is the identity. Hence (t) ⑹ (t)’ = 1 . The inverse {y) of (r) is 
also triangular of the same form as (t) and (0) = This 

proves the following 

Theorem 1. Let (13) be a matrix of a positive definite symmetric 
scalar product. Then there exists a triangular matrix (v) such that 

⑹ = iy)W- 

We consider now the relation between Cartesian bases and 
matrices. Let (^i, v 2y . • • ， v n ) be a definite Cartesian basis. Then 
if (uiy u 2 , • • •，is a second such basis, the matrices of {x y y) 
relative to these bases is 1 . Hence if (<r) is the matrix of («i, U 2 y 
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• • •， u n ) relative to (t；i, v 2y …， v n ) y then (cr)((r) f = 1. A matrix 
satisfying this condition: 

⑺ （4)/ = 1 

is called an orthogonal matrix. Conversely, if (<r) is any orthogonal 
matrix and Ui = 〜奶 ， then the matrix of (x y y) relative to 
(u ly u 2y • • •， u n ) is (< 7)1 (a*)’ = 1 . Hence the us form a Cartesian 
basis. Thus we see that，if one Cartesian basis is known, all 
others can be obtained from it by applying orthogonal matrices. 
We have a 1—1 correspondence between the Cartesian bases and 
the orthogonal matrices. 

If (cr) is orthogonal, then (det (or)) 2 = 1 . Hence det (<r) = ± 1 . 
If det (<r) = 1 ， we shall say that (o-) is proper, otherwise (o-) is 
improper. It is readily verified that the orthogonal matrices con¬ 
stitute a subgroup 0 ( 中， w) of the group L($， n). The proper or¬ 
thogonal matrices form an invariant subgroup n) in 0(^ y n) 
and the index of Oi in 0 is two. 

If two Cartesian bases are related by a proper orthogonal ma¬ 
trix, then we say that the bases have the same orientation and, 
if the matrix relating the bases is improper，we say that the bases 
have opposite orientation. Thus the Cartesian bases fall into two 
mutually exclusive classes, namely, those that have the same 
orientation and those that have opposite orientation to a par¬ 
ticular Cartesian basis v 2y …， v n ). We note that a change 
of sign of one vector or an odd permutation of the vectors changes 
the orientation. 

Suppose again that (e u e 2y …， e n ) is any basis and let ( 7 ) be 
the matrix of this basis relative to the Cartesian basis (vi y v 2y 
•••，〜)• Since the e’s form an arbitrary basis, the matrix ( 7 ) is 
an arbitrary matrix in L(^ y n). Now we have seen that there 
exists a Cartesian basis {u u u 2i • • •， u n ) whose matrix relative to 
(eiy e 2y • • •，^n) is a triangular matrix (r). The matrix of (ui y u 2y 
•••， u n ) relative to (u ly v 2y …， v n ) is the product (r)( 7 ). Since 
(u ly u 2y • • •， u n ) is Cartesian, (r)(y) = (a) is orthogonal. Hence 
we have the following 

Theorem 2. If ( 7 ) e n) y $ the field of real numbers 、 then 
( 7 ) may be factored as {v) (a) where {y) is triangular and (cr) is 
orthogonal. 
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EXERCISES 

1. Show that the matrix (v) in the preceding theorem can be taken to have 
positive diagonal elements. Show that, if this normalization is made, then (y) and 
(a) are uniquely determined by ( 7 ). 

2. Decompose 

r-1 0 2 -2' 

3 4-1 7 

12 1-1 
.02 0 1 . 

as a product of a triangular matrix and an orthogonal matrix. 

3. Show that, if (/3) is the matrix of a positive definite symmetric scalar 
product, then det (ff) > 0 . Generalize this to prove that every diagonal minor 
of (/3) is positive. 

4. Prove that, if (x,y) is a positive definite symmetric scalar product, then (u y v) 2 
< («, u)(v, v) for any u and v and that equality holds only if u and v are linearly 
dependent. 

5. Prove the triangle inequality for lengths of vectors: 

(« + y, « + y) H < {u y - {- (v y v) 

2. Linear transformations and scalar products. If yf is a 

linear transformation of 9? over $ into itself, then g(x y y)= 
{xA^y) is a second scalar product in the space. Conversely let 
g(x y y) be any scalar product in dt. Then if we hold x fixed, the 
function g(x y y) is linear in jy. Hence, as we have shown in Chap¬ 
ter V， there is a uniquely determined vector xA in 9? such that 
y) = y) for all y. The mapping A is linear. This 
shows that any scalar product in 況 can be obtained from the fun¬ 
damental scalar product {x^y) by applying a linear transformation 
A in the above manner. The theory of scalar products in 9? is 
therefore equivalent to the theory of linear transformations in 5R. 

For the most part we shall adopt the linear transformation 
point of view. We recall first the definition of the transpose A f 
relative to y) of the linear transformation A\ A f the linear 
transformation in 況 which satisfies the condition 

(8) = (xJ y y) 

for all x y y in There is only one linear transformation that 
satisfies this condition, and the requirement (8) can be reduced 
to the n 2 equations 

(ui y UjA f ) = (uiA y Uj\ i y j = 1, 2, • • n 
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for a basis {u u u 2y •…， u n ). If the basis is Cartesian these con¬ 
ditions imply that A r is the linear transformation whose matrix 
relative to {u u u 2y • • •， u n ) is the transpose of that of A, If 

U{A = l^aaUic and UjA r = X^jiUiy 

then 


UjA r ^) = Ul) = ^ji 

{uiA y Uj) = ^aik(uk y Uj) = ai 3 \ 

Hence ⑹ =(a)’. (Cf. p. 145.) 

We recall the fundamental algebraic properties of the mapping 


A — A，.. 


(A + BY = ^ + {A B) f = B f A f . 


Also it is clear from (8) and the symmetry of (x y y) that 

A n = A. 


3. Orthogonal complete reducibility. If © is any subspace 
9 ^ 0 of (x y y) is non-degenerate in ©. In fact， {x y *v) 〆 0 if 
x 〆 0. It follows from this that the orthogonal complement 
©丄 of © is a true complement, that is， 況 =© ㊉ ©丄 (cf. p. 151). 
It is easy to determine a basis for @丄 . For this purpose one 
needs to have a Cartesian basis (u ly …， u r ) for ©• This can 
be supplemented to a basis (ui y u 2y •. •， u r \ e r+ i y •••，〜) for 5K. 
Then Schmidt’s orthogonalization process yields the Cartesian 
basis (ui y u 2 , •••， u n ) y and it is clear that ©丄 = (從 r+i) 

• • • ，以 n) • 

Suppose now that 12 is an arbitrary set of linear transformations 
in dt over 中. We shall call 0 orthogonally completely reducible if 
the orthogonal complement ©丄 of any subspace © invariant 
under Q, is also invariant under 12. Since 9? = © ㊉ ©丄， it is clear 
that orthogonal complete reducibility implies ordinary complete 
reducibility. We shall see that this property is enjoyed by many 
important types of linear transformations in 9?. If is orthogo¬ 
nally completely reducible, we can decompose 況 as a direct sum 
9 ?i ㊉況 2 ㊉ • ••㊉ 9^ of subspaces that are invariant and irreduci¬ 
ble relative to Q and that are, moreover, mutually orthogonal. 
Thus let be an irreducible invariant subspace relative to 
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Then is invariant and = 況 i ㊉ 9?i x . Let 9^2 be an irre¬ 
ducible invariant subspace contained in 沉 Then + 9?2 == 
況 l ㊉況 2 and these two spaces are orthogonal. Next we may 
write 況 = 況 1 ㊉況 2 ㊉（況 l + 況 2 ) 丄. Continuing in this way we 
obtain the required decomposition. 

There is a very useful test for orthogonal complete reducibility 
which is based on the following 

Theorem 3. If Q> is any set of linear transformations and @ is 
invariant under Q y then the orthogonal complement ©丄 invariant 
under Q! the set of transposes of the linear transformations in 12. 

Proof. Let ^ e © and y e @气 Then xA e © for any A in 
Hence {xA, j) = 0 and also yA f ) = 0. Since this holds for 
all x in yA f 8 Since ^ is arbitrary in ©丄， this shows that 
© x is invariant under Q f . 

We can now state the following important criterion. 

Corollary. A set 12 is orthogonally completely reducible if and 
only i/Q, and Q! have the same invariant subspaces. 

4. Symmetric, skew and orthogonal linear transformations. 
Of special interest in Euclidean geometry are the following types 
of linear transformations : Symmetric ， defined by the condition 
A r — A, skew defined by A r — 一 A and orthogonal defined by 
A r = A~ x . These conditions can also be given in terms of the 
associated scalar products. Thus A is symmetric if and only if 
{xA^y) is symmetric. This is readily verified. Similarly A is 
skew if and only if {xA^y) is a skew scalar product in 9?. If (a) 
is the matrix of A relative to a Cartesian basis (ui y u 2y • • •， u n \ 
then A is symmetric (skew) if and only if (a) is symmetric (skew). 

In order to see the geometric meaning of orthogonal linear 
transformations we must recall that (u y u) gives the square of 
the length of the vector u. The condition AA r = 1 = A r A im¬ 
plies that 

(9) {uA y uA) — (u y uAA r ) = (u y u). 

Hence A preserves the length of any vector. We now prove the 
converse, namely, if A is any linear transformation that leaves 
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the length of every vector unaltered，then A is orthogonal. For 
if (9) holds for all then 


(0 + y)A, (x + y)A) = (x + y y x + y) 
for all x and Expanding and cancelling off equal terms. 


2{xA,yA) = 2(x, y). 

Hence yAA ’、 = (x y y) for all x y y. Since y) is non-degen¬ 
erate this implies that AA f = 1. 

It is clear that A is orthogonal if and only if its matrix (a) 
relative to a Cartesian basis is orthogonal. Another way of stat¬ 
ing this result is that A is orthogonal if and only if the transform 
{u\A^ •… ， u n A) of a Cartesian basis is a Cartesian basis for 

The matrix (a) has determinant 1 or determinant —1. In 
the former case {uiA y … ， u n A) has the same orientation 

as (uiy a 2 ，• • • ， u n ). Then A is called a rotation in 9?. 

5. Canonical matrices for symmetric and skew linear trans¬ 
formations. If © is a subspace invariant under a linear transfor¬ 
mation A that is symmetric, then clearly © is invariant under A f • 
Hence the set consisting of A alone is orthogonally completely 
reducible. Our discussion of orthogonally completely reducible 
sets suggests the following procedure for obtaining a canonical 
matrix for A. 

Let % be a non-zero vector in 9? and let ju x (X) be its order (see 
p. 67). If 7r(X) is an irreducible factor (leading coefficient 1) of 
/x x (X) and Mx ( 入 ） = 7r(X)^(X), then y = xv{A) has the order 7r(X). 
Since 中 is the field of real numbers the irreducible polynomial 
7r(X) is either linear or quadratic. We shall now show that the 
symmetry of A assures that 7r ( 入 ） is linear. Otherwise (j y yA) 
is a basis for the cyclic space {jy}，and this basis yields the matrix 


( 10 ) 


o r 

jS a. 


where 入 2 — a 入一 = 7r(X). On the other hand, if we choose a 
Cartesian basis in {jy}, then we obtain a symmetric matrix 


(ID 



€J 
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for A in {y}. Since (10) and (11) are similar, 

入 2 一 q ； 入 — 卢 = 入 2 一 （y + € )入 + (了 € — 5 2 ). 

The discriminant of this quadratic is 

(7 + €) 2 — 4(ye — S 2 ) = (7 — €) 2 + 45 2 > 0 

and this contradicts the irreducibility of 71*( 入 ). Thus we see that 
7 r ( 入） must be linear so that = [y] is one dimensional and yA 

= py- 

We now replace y by a multiple y\ that has length 1 . Then 
yiA = Pijyi, Pi = p. Also 9? = [ji] ® [yi ] 丄 and A induces a sym¬ 
metric transformation in [yi^. Hence we can find a y 2 of length 
1 in [yi] ± such that jy 2 ^ = P 2 J 2 - Next we use the decomposition 
dt = \jiyy 2 ] + [ji ，）2] 丄 to obtain ay 3 of length 1 in [yi ， J 2] 丄 such 
that y^A = p 3 jy 3 . We remark that the yi thus obtained are or¬ 
thogonal in pairs. Hence when we have finished our process, we 
get a Cartesian basis y 2 y • • • ， y n )- The matrix of A deter¬ 
mined by this basis is 

( 12 ) diag {/>i ， P 2， … ， Pn}. 

If we recall that the passage from one Cartesian basis to another 
is given by an orthogonal matrix，we see that the following theo¬ 
rem holds. 

Theorem 4. If (a) is a real symmetric matrix y then there exists 
a real orthogonal matrix (a) such that {a) (a) (o -) -1 is a diagonal 
matrix. 

We can also arrange to have (<r) proper. This can be done by 
changing the sign, if necessary, of one of the yi ， We note also 
that the pi in the canonical matrix ( 12 ) are the roots of the char¬ 
acteristic polynomial of this matrix. Hence they are also the 
roots of the characteristic polynomial of (a). We have therefore 
proved incidentally the 

Corollary. The characteristic roots of a real symmetric matrix 
are real. 

We pass now to the theory of a skew linear transformation in 
Euclidean space. Let A be skew and，as above, let jy be a vec- 
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tor 7 ^ 0 whose order is an irreducible polynomial 7 r(X). If tt(X) 
is linear, then yA = py. Hence p(j y y) = iyA^y) = — (jy, yA) 
=—p(jyy)y and this implies that p = 0. If tt(X) is quadratic, 
we choose a Cartesian basis in {j}. We then obtain a skew sym¬ 
metric matrix 

- 0 8 , 

.-S 0.' 


The polynomial tt(X) is the characteristic polynomial of this ma¬ 
trix. Hence 7r(X) = X 2 + 5 2 where 8^0. If we apply the 
method used above for symmetric mappings, we can decompose 
the space as a direct sum of mutually orthogonal spaces i = 
1 ， 2 ， ••• ，々， such that each = {yi} y and the minimum poly¬ 
nomial 7r z . ( 入 ) of jyf is either 入 or it is of the form 入 2 + 8i 2 y 8{ ^ 0. 
We can arrange the so that Ti(\) = X 2 + 5 t - 2 for i = 1 ， 2 ， • • •， 
k and %( 入） =X for i > k. If we choose Cartesian bases in the 
©t, we obtain a Cartesian basis for 況 by stringing these bases 
together. The matrix of A relative to this basis is 



0 


-h 

0 


0 


0J 
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This proves the following 

Theorem 5. If (a) is a real skew symmetrix matrix，then there 
exists a real orthogonal matrix (a) such that (<r) {a) (<r) _1 has the 
form (13). 

As for symmetric matrices the canonical form is completely de¬ 
termined by the characteristic polynomial 

X n-2fc JJ ( X 2 + g.2^ g. ^ 0 
1 

of (a). We remark also that the characteristic roots are pure 
imaginaries. 

EXERCISES 


find a proper orthogonal matrix (c) such that ((7)(a)(cr) 一 1 is diagonal. 

2 . Prove that, if g(x y y) is a symmetric scalar product in Euclidean space, then 
there exists a Cartesian basis for 況 relative to which the matrix of g is diagonal. 

3. Prove that, if (a) is a real symmetric or skew symmetric matrix of rank p, 
then there is a non-zero p-rowed diagonal minor in (a:). 

6. Commutative symmetric and skew linear transformations. 
If p is a root of the characteristic polynomial /( 入 ） of the sym¬ 
metric linear transformation, then the subspace 況入 — p of vec¬ 
tors y such that yA = py is 9 ^ 0. We call 9?\_ p the characteristic 
space corresponding to the root p or to the factor \ — p of /(X). 
If A is skew and X is a factor of /( 入 )， we define in a similar man¬ 
ner the characteristic space 況入 . The other irreducible factors of 
/(X) have the form 7r(X) = X 2 + 5 2 , 8 9 ^ 0. Corresponding to 
such a factor we define the characteristic space 9?:( 入 ） to be the to¬ 
tality of vectors y such that yir{A) — 0. As we have seen in the 
preceding section, 9^(x) 〆 0. 

If B is any linear transformation which commutes with it 
is clear that B maps each characteristic space of A into itself. 
For ， evidently, yTr(^4) = 0 implies that yir{A)B = {yE)ir{A) 
= 0 .* 

* The ideas which occur here have been discussed in a more general form in § 9 of 
Chapter IV. 


0 2 3 


2 2 2 


12 0 




f 

I 
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Now let 0 be a set of linear transformations such that 1) any 
two linear transformations of 0 commute, 2) every transforma¬ 
tion of 0 is either symmetric or skew. In order to determine 
canonical matrices for the set ^ we consider first the case in 
which 0 is an irreducible set. The result that we shall establish 
is the following 

Theorem 6. If a Euclidean space 9? is irreducible relative to a 
commutative set of linear transformations which are either sym¬ 
metric or skew，then dim 9? < 2. 

Proof. Let 7r ( 入 ) be an irreducible factor of the characteristic 
polynomial of any ^ e^l. Then the characteristic space 沉 “ 入 ） of 
A is invariant relative to Q. Hence 9? x (x )= 沉 so that = 0. 
If A is symmetric，then we know that 7r ( 入） = 入 一 p; hence, in 
this case，J is a scalar multiplication. If A is skew，either 7r ( 入） 
= 入 ， in which case J = 0， or 7r(X) = X 2 + 5 2 , S 〆 0. In the 
latter case A 2 = 一 5 2 1; hence A~ x exists and is skew. Then if 
B is any other skew transformation in the set, 

M = BA- 1 = A~ l B = (一 A - 1 )， (一 B，）= {A - 1 Y B r = M 

is symmetric. Since M commutes with every member of 0, the 
argument used before shows that M is a scalar multiplication. 
Hence B = ixA. Thus we see that either the set Q consists of 
scalar multiplications only, or S2 consists of scalar multiplications 
and multiples of a single skew A in this set. In the former case 
every subspace of 9t is invariant relative to 0. Hence by the 
irreducibility of 9J, dim 9? = 1. In the second case we can find 
a two-dimensional subspace which is invariant and irreducible 
relative to the chosen skew transformation A. Clearly this space 
is also invariant relative to every member of 12. Hence，here 
dim 5R = 2. This completes the proof. 

Now suppose that 12 is an arbitrary commutative set of sym¬ 
metric or skew linear transformations in a Euclidean space. It 
is clear by the Corollary to Theorem 3 that every set of sym¬ 
metric and skew linear transformations is orthogonally com¬ 
pletely reducible. This implies that we may write dt = @i ㊉ ©2 
㊉ • ••㊉ where the are mutually orthogonal and irreducible 
and invariant relative to We can now apply Theorem 6 to 
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conclude that the spaces are either one-dimensional or two- 
dimensional. Moreover, the proof of Theorem 6 shows that the 
symmetric A are scalar multiplications in the and that the 
skew A are multiples of a particular one. If we choose Cartesian 
bases in the ©“ we obtain a Cartesian basis for 9? relative to 
which the matrices of the e ft all have the form 


(14) 


(冷 2) 




where (Pi) is either a one- or two-rowed scalar matrix or 


(15) 


⑽ = 

L — q 


ei 

0 . 


In matrix form our result is the following 

Theorem 7. Let w be a set of commutative real matrices which 
are either symmetric or skew symmetric. Then there exists a real 
orthogonal matrix (a) such that、Jor each (a) e co 3 (cr)(a) (o-) -1 has 
the form (14). 

EXERCISES 


1. Prove that if A is symmetric, then any two distinct characteristic spaces 
of A are orthogonal. Also show that 9? is a direct sum of the characteristic sub¬ 
spaces relative to A, 

2 . Prove that, if co is a set of commutative real symmetric matrices, then there 
exists a real symmetric matrix (5) such that each (a) e co is a polynomial in (5). 

7. Normal and orthogonal linear transformations. A linear 
transformation A is called normal if it commutes with its transpose. 
Special cases of such mappings are the symmetric, skew and 
orthogonal linear transformations. If A is any linear transforma¬ 
tion, we may write A = \{A + A r ) + \{A — A f ) = B + C 
where B = + A f ) is symmetric and C = \{^A — A f ) is 

skew. This decomposition into a symmetric and a skew part is 
unique. For if B + C = Bx Ci where B\ = Bi and C\ = 
— Ci, then 


(B - B,) = (C x - C). 
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Since B — Bi is symmetric and Ci — C is skew, B — Bi = 0 
=Ci — C. We may therefore call B and C respectively the sym¬ 
metric and the skew part of A. We note now that A is normal if 
and only if B and C commute. This is clear since B = ^{A + A f \ 
C = \{A — A f ) and A = B + C y A f = B — C. This remark 
shows that the results on commutative symmetric and skew lin¬ 
ear transformations can be applied to the study of normal linear 
transformations. Using this method we see that there exists a 
Cartesian basis relative to which B and C have matrices of the 
form (14). Since B is symmetric and C is skew we know that ， 
if (ft) is a one-rowed block，then it is 0 for C and if (ft) is two- 
rowed, then it has the form (15) for C and is scalar for B. The 
matrix of A = B + C is the sum of the matrices of B and of C. 
Hence it has the form (14) where each (ft) is one-rowed or 

(16) m c/ 

L — €i PiJ 

9^ 0. 

A matrix is called normal if it commutes with its transposed. 
A linear transformation A is normal if and only if its matrix 
relative to a Cartesian basis is normal. Our discussion therefore 
yields the following 

Theorem 8. If (a) is a real normal matrix，there exists an or¬ 
thogonal matrix {a) such that (a*) (a) (a) -1 has the form (14) where 
each (Pi) is either one-rowed or is a two-rowed matrix of the form 
(16). 

We consider finally the special case of orthogonal transforma¬ 
tions. Here the one-rowed blocks (fii) are associated with vec¬ 
tors yi 0 such that yiA = Since A does not change the 

length of vectors, 氏 = 土 1. Also A is orthogonal in the two- 
dimensional subspaces ©*•• Hence the blocks (16) are orthogonal. 
Thus 

Pi fpi — €»] fl O' 

=r • 

.—Pii l€i PiJ 10 1. 

This reduces to the single condition 

(17) pi 2 + €» 2 = 1. 
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We can determine a number di such that cos = pi y sin di = 
Then (16) becomes 


( 18 ) 


COS 0i 
— sin di 


sin di 
cos di 


Theorem 9. Every real orthogonal matrix is conjugate in the 
group of orthogonal matrices to a matrix (14) in which the (j8») are 
either one-rowed matrices (±1) or are of the form (18). 


EXERCISES 

1. Prove that an orthogonal linear transformation is proper or improper ac¬ 
cording as the multiplicity of the root — 1 of the characteristic polynomial is even 
or odd. 

2 . Prove that, if / is a rotation in an odd-dimensional Euclidean space, then 
there exists a vector « _ 0 such that uA = u. 

3. Prove that every set of orthogonal linear transformations is orthogonally 
completely reducible. 

4. Show that, if 0 is orthogonal and does not have — 1 as a characteristic root, 
then S = (0 — 1)(0 + 1) -1 is skew and 0 = (1 + 6*)(1 — 6 1 ) -1 . Show that, if O 
is orthogonal and 1 is not a characteristic root, then ^ = (0 + 1)(0 - I )" 1 is 
skew and 0 = ( 6 *+ 1 )( 6 * — 1 ) -1 . 

8. Semi-definite transformations. A linear transformation A 
is said to be positive definite if it is symmetric and if the asso¬ 
ciated symmetric bilinear form {xA y y) is positive definite. This, 
of course，means simply that^) > 0 for all % 〆 0. It is 
useful also to generalize this notion slightly by defining A to be 
(non-negative) semi-definite if {xA y x) >0 for all x. It is evi¬ 
dent from the definition that a positive definite transformation 
is semi-definite and 1-1. The converse holds also. This will 
follow from the following criterion for definiteness and semi¬ 
definiteness. 

Theorem 10. A symmetric transformation A is positive definite 
{semi-definite) if and only ij its characteristic roots are all positive 
{non-negative、. 

Proof. We know that there exists a Cartesian basis (ji y 
• • •， yn) for 況 such that each yi is a characteristic vector in the 
sense that yiA = piji. The pi are the characteristic roots. 
Now = (piy^yi) = piiy^yi) has the same sign as p». 
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Hence if A is definite (semi-definite) each pi is positive (non¬ 
negative). Conversely suppose that > 0 (> 0) for all i and 
write x = Then 


{xA y x) 


= 





n 

S ^iPiyiy 



= 

1 

If all the pi are > 0, this is > 0 unless each ^ = 0. Hence pi > 0 
insures definiteness. Also it is clear that，if the pi > 0, then 
{xA^ x) > 0. 

If A is 1—1，then 0 is not a characteristic root of A. Hence if 
A is semi-definite and 1—1，all of its characteristic roots are posi¬ 
tive. Theorem 10 then shows that A is definite. 

If A is an arbitrary linear transformation in Euclidean space ， 
then B = AA f is semi-definite since {xB y x) = {xAA\ x) — 
xA) > 0. We note also that B and A have the same null- 
space; for it is clear that, if zA = 0, then zB = 0. On the other 
hand, if zB = 0, then 0 = {zB^ z) = {zA y zA) y and this implies 
that zA = 0. As a consequence of this remark we see that B is 
positive definite if and only if A is 1-1. 

We shall now prove the following useful result : 


Theorem 11. Any semi-definite transformation B has a semi- 
definite square root P {that is y P 2 = B) y and P is unique. 

Proof. The determination of a semi-definite P such that 
P 2 = B is easy. We choose a Cartesian basis {y u y 2y . • y n ) 
such that yiB = piyi and we know that the pi are > 0. Hence 
we can define P to be the linear transformation such that yiP 
= Pi^yi- Clearly P 2 = B. Also since the matrix of P relative 
to a Cartesian basis is symmetric, P is symmetric. Finally 
since the characteristic roots p^ 2 of P are non-negative, P is semi- 
definite. To prove the uniqueness of P we arrange the charac¬ 
teristic vectors of B in groups in such a way that the first ri\ are 
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those that go with the root p ly the next n 2 are those that go with 
p 2 (t^pi), etc. Also we introduce the spaces 

況 1 = LVl ， JV2 ， • • * y y n i]y 況 2 = L^ni + l ， Jwi+2 ， • • • ， Jm+nj ， • • • 

so that 況 = 9?i ㊉ 況 2 ㊉ • • • ㊉ 況 a {h = number of distinct char¬ 
acteristic roots). If Ui is any vector in 9^， clearly UiB = piUi ， 
On the other hand，let u — U\ + u 2 + • • • + Uh where Ui z 9 ^， be 
any characteristic vector belonging to the root that is, uB = 
piU. Then 

PiU = uB = {u\ + "2 + • • • + = U\B + U 2 B + • • • + UfJB 

— P\U\ + P2^2 + . • • + PhUh. 

Hence Uj = 0 j 9 ^ i and u — Uiz Thus we see that the 
space is just the characteristic subspace of 沉 corresponding 
to the characteristic root pi of B. As we have seen the charac¬ 
teristic subspaces of a linear transformation B are invariant with 
respect to any linear transformation C that commutes with B. 
If P is any linear transformation such that P 2 = B y then BP 
=PB and dtiP Q dti. Thus if P is semi-definite, then P induces 
a semi-definite transformation in each dU. Now we can find a 
Cartesian basis (Wi ⑴， • • • ， 《 ; 叫 (1) ) for 9 ^. such that Pwj ⑴ 
=yjWj^K Then = P 2 Wj (i) = Hence 7 / = pi 

and jj = p^. This shows that P coincides with the scalar mul¬ 
tiplication by pi V2 in the space Hence P is the mapping we 
constructed before. 

EXERCISES 

1. Show that any symmetric A whose negative characteristic roots have even 
multiplicities has a square root. 

2. Prove that any symmetric A has a unique symmetrc cube root. 

9. Polar factorization of an arbitrary linear transformation. 

Evidently any real number can be written as a product of a non¬ 
negative real number by one of the numbers 1, 一 1. This result 
can be generalized to linear transformations in Euclidean space 
as follows 

Theorem 12 . Every linear transformation A in Euclidean space 
can be written as a product A — PO where P is semi-definite and 




_EUCLIDEAN AND UNITARY SPACES_ 189 

0 is orthogonal. P is uniquely determined while 0 is unique if and 
only ij A is 1-1. 

Proof. The proof is somewhat simpler in the important case 
in which A is 1-1; hence we consider this case first. We form 
the positive definite transformation B = AA f and its positive 
definite square root P. Set 0 = P~ l A. Then 

00, = PUP- 1 = P- 1 BP~ 1 = p-ip2p-i = j 

and this shows that 0 is orthogonal. Since A — P0 y the exist¬ 
ence of the representation is established for A 1-1. 

The proof in the general case is basically the same as the fore¬ 
going. Again we define B = AA\ and we take P to be the semi- 
definite square root of B. Our task is to determine an orthogonal 
transformation 0 such that A — PO. We define first a mapping 
of the space © = dtP into the space ©i = ^SiA by specifying that 
xP — xA. If xP = yP y (x — y)P = 0 and (x — y)B = 0. 
Since B = AA\ this implies that (x — y)A = 0 so that xA = 
yA. This shows that our correspondence is single-valued. It is 
now clear that it is linear. Also this mapping preserves lengths 
of vectors, since 

xA) = {xAA f y x) = (xB y x) 

and 

(xP y xP) = {xP 2 y x) = (xB y x). 

Now A y B and P have the same null space; hence they have the 
same rank. It follows that the orthogonal complements ©丄 and 
have the same dimensionality = h. Now let (ui y u 2y • • • ， Uh) y 
v 2y … ， Vh) be Cartesian bases for these spaces. Then the 
linear transformation of @丄 into ©x -1 that sends Ui into Vi pre¬ 
serves lengths. It follows that the mapping 

0: xP + ^oLiUi xA + XaiVi 

is an orthogonal transformation. Clearly xPO = xA for all x so 
that A — PO as required. 

1( A = P0 y AA f = P 2 . Hence P is necessarily a square root 
of the semi-definite transformation B = AA r . “ence 户 is unique. 
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If A is 1-1 ， it follows that 0 = P~ l A is also unique. On the 
other hand, if A is not 1-1 ， then A > 0 in the above notation. In 
this case there are many choices available for the transformation 
of ©丄 into ©工丄 and these give different determinations of an or¬ 
thogonal transformation 0. This completes the proof. 

In a similar manner we can establish a factorization A = 0\P\ 
where 0\ is orthogonal and P\ is semi-definite. This can also 
be deduced by applying Theorem 12 to A’• 

EXERCISES 

1. Decompose 

- 1-1 2 ' 

2 1 3 

.1 0 一 5. 

as a product of a positive definite matrix and an orthogonal matrix. 

2. Show that A = PO is normal if and only if PO = OP. 

10. Unitary geometry. Unitary geometry is the study of a vec¬ 
tor space over the field of complex numbers relative to a positive 
definite hermitian scalar product (x y y). It is evident at the out¬ 
set that this geometry will have the essential features of Euclidean 
geometry. On the other hand，we can expect some simplifica¬ 
tions here due to the fact that the underlying field is algebraically 
closed. Consequently the theory of canonical matrices will be 
simpler than in the real case. It is not necessary to duplicate 
our previous discussion in all detail. In the main we shall be 
content to state the principal results and will give proofs only 
when new methods yield simplifications over the corresponding 
proofs in the Euclidean case. 

We suppose now that 中 is the field of complex numbers and 
that y) is a hermitian scalar product relative to the usual 
mapping a ^ a. Then we know that (x y x) is real for any x. 
We shall assume, moreover, that (x y y) is positive definite in the 
sense that (x y > 0 if % 〆 0. This assumption implies that 
there exists a basis (u u u 2y • • • ， u n ) that is unitary in the sense 
that (u iy Uj) = d ijy i y j = 1, 2, •••，”• The passage from one 
unitary basis to another is given by a matrix (cr) that is unitary 
in the sense that 

(<r)(5)，= 1 = 
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These matrices constitute the unitary subgroup n) of n) y 
中 the complex field. The Schmidt orthogonalization process holds 
and this enables us to carry over all of the results of § 1. The 
analogue of Theorem 1 is that, if (J3) is the matrix of a positive 
definite hermitian scalar product, then (0) has the form (v) {v) for 
a suitable triangular matrix (y) with complex elements. The ana¬ 
logue of Theorem 2 is obtained by replacing the word “real” by 
“complex” and “orthogonal” by “unitary” in its statement. 

The transpose of a linear transformation A is defined as usual. 
If {ui y u 2y • • •， u n ) is a unitary basis, then the matrix of A' is 
the conjugate transpose ⑹ ’ of the matrix of A. Thus A is 
hermitian, A f — A y if and only if (a) is hermitian; A is skew her- 
mitian^ A f = if and only if (a) is skew hermitian; A is unitary ， 
A f A = 1 = AA\ if and only if (a) is unitary; and A is normal ， 
AA r = A 1 A y if and only if {a){a) 1 = Skew hermitian 

transformations need not be studied as a separate case since their 
theory can be reduced to that of hermitian transformations by 
observing that, if A is skew hermitian，then tA (i 2 = —1) is her¬ 
mitian. This follows from the fact that the transpose of the 
scalar multiplication x jjlx is the scalar multiplication x fix. 
Hence x —> ix is skew hermitian and, since it commutes with 
A, tA is hermitian. 

Suppose now that A is hermitian and let p be a root of the 
characteristic polynomial. Let y be a corresponding characteris¬ 
tic vector. Then 

piy^y) = (pyyy) = (y^yy) = {y^ yA) = {y y P y) = (y y y)p. 

Since (y y y) 9^ 0, this implies that p = p is real. We normalize 
y to obtain a multiple 力 such that (ji y yi) = 1. Then also y x A 
=PiJVi ， p = Pi. If © is any subspace, we denote the orthogonal 
complement consisting of the vectors y f such that (y y y ; ) = 0 
for all y e® by ©' This space is a complement of @ and，if © 
is invariant under then so is © 丄 . If we apply this remark to 
© = [yi] y then we see that SR = = Oi] ㊉ LVi]' L and that [y^A £ 
[ 力 ] 丄 . Hence we can find a real number p 2 and a vector y 2 in 
[>^]丄 such that y 2 A = p 2 y 2 - Next we write 0? = [jyi,jy 2 ] ® 
[yi ， 力 ] 丄 ， and we repeat the argument with [y ly This leads 
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finally to a unitary basis relative to which the matrix of A is 

diag {pi ， P 2 ， …， Pn} 

where the pi are real. 

Theorem 13. If (a) is a complex hermitian matrix，there exists 
a unitary matrix (<r) such that (a) (a) (a) - 1 is a real diagonal matrix. 

Evidently a similar result holds also for skew-hermitian matrices. 
As in the Euclidean case we may prove next that, if co is a set of 
commutative hermitian and skew-hermitian matrices，then there 
exists a single unitary matrix (a) such that every (cr) (a) (a) 一 1 is 
diagonal for every a in co. This leads as before to Theorem 13, 
with the word “real” omitted, for normal matrices and conse¬ 
quently also for unitary matrices. For the latter the character¬ 
istic roots are of absolute value 1. This follows from 

I p \ 2 {y,y) = (y^yy^) = y) 

if yA — py. The principal theorem on unitary matrices can 
also be derived directly by using the same argument that we 
used in the hermitian case. The important remark is that，if @ 
is a subspace invariant under a unitary transformation, then the 
orthogonal complement is also invariant. 

If ^ is a hermitian linear transformation, the associated bi¬ 
linear form {xA^ y) is hermitian; for 

{yA, x) = (j y xJ) = (xJ y y). 

It follows that {xA^ x) is real for any x. Now as in the Euclidean 
case we define A to be positive definite {semi-definite) if x) 
> 0 (> 0) for all x 9 ^ 0. The discussion that we gave in the 
Euclidean case can be carried over without change. Thus we 
can prove that any semi-definite transformation has a unique 
square root. As before，this can be used to establish the polar 
factorization. Every linear transformation in unitary space can be 
written as A = PU where P is semi-definite and U is unitary. P 
is unique and U is unique if and only if A is 1-1. 
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We shall prove now another theorem that is applicable to arbi¬ 
trary linear transformations and matrices in a unitary space. 
This is the following 

Theorem 14. If (a) is a matrix with complex elements 、 then 
there exists a unitary matrix (a) such that (cr) (a) (o-) _1 is triangular. 

Proof. In order to prove this we let A be the linear transfor¬ 
mation whose matrix relative to some unitary basis v 2y • • •， 
v n ) is the given matrix (a). If pi is a characteristic root，there 
exists a vector yi such that (九 y\) = 1 and y^A — pijyi. We 
can find a unitary basis (ji y y 2 , - - y n ) that includes the vector 
yi ， Then，since y^A = p\yu the matrix of A relative to this 
basis is 

Pi 0 • • • 0 

P21 P22 _ … P2n 

(19) ⑹ =• • • 

參 • • 

• • 參 

-Pnl Pn2 * Pnn 

If (m) is the matrix of (jyi, jy 2 , - - *,^n) relative to (v ly v 2y • • • ， v n ) y 
then (ju) is unitary and (/x)(a)(ju)- 1 is the matrix ⑹ of (19). We 
may now assume that there exists a unitary matrix {y) oi n — \ 
rows and columns such that 

P 22 • • 

W • • • 

~Pn2 • • 

Then the matrix (r)= 


W ⑻(了广 1 = 


where (a) = (t)(jll) is unitary. 
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EXERCISES 

1. Show that Theorem 14 holds for any set co of commutative complex ma¬ 
trices. 

2. What is the analogue of Theorem 14 in the real case? 

3. Show that a triangular matrix is normal if and only if it is diagonal. Use 
this to prove the theorem on canonical forms for normal matrices with complex 
elements. 

11. Analytic functions of linear transformations. In treating 
analytic questions on matrices we shall take as our point of de¬ 
parture the notion of convergence of sequences of matrices. If 

1, 2 y 3 y …， is an infinite sequence of matrices in 
$ the field of complex numbers, we say that {(a (/b) )} converges 
to ( a )， > (a) y if the sequence of complex numbers aij W —> 
ocij for every j = 1 ， 2， • • •, n. The limit matrix (a) is unique 
since this is the case for sequences of complex numbers. Using 
our definition of convergence it is clear that addition and multi¬ 
plication of matrices are continuous functions) that is, if (a (/b) ) 


—> (a) and (/5 (/b) ) 

—> ⑹， then 


(20) 

(W)) + ，)） 

- > (a) + ⑻ 

(21) 


— W ⑹. 


To convince ourselves of the validity of these basic rules we have 
only to observe that the (/, j) element of the sum (product) of 
two matrices is a continuous function of the 2n 2 coordinates 
aij y An important special case of (21) is that, if (a ( 幻） 一 > (a) 
and (fx) is non-singular, then 

(22) — (m)(«)(m) _1 . 

The last result can be used to define convergence for linear 
transformations. Let k = 1 ， 2， . • be an infinite sequence 

of linear transformations in 9? over $ and let (a (A;) ) be the matrix 
of A k relative to a basis (e ly e 2y … ， e n ) of 3J. We shall say that 
{Ak\ converges to the linear transformation A、A if 
—> (a) where (a) is the matrix of A. Because of (22) it 
is clear that the condition A \s independent of the choice 

of basis in 9?. 
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We shall now consider power series in a linear transformation. 
As for ordinary series，we assign a meaning to 

(23) Tol + + 72^ 2 + • • • ， 7i in 

if the sequence of partial sums {6 * 山 

Sk — Tol + 7i^ + • • • + yj^4 k 

converges. The limit of is called the sum of (23)，and we 
write 

Tol T2^ 2 + • • • = S, 

The principal result we wish to prove is the following 

Theorem 15. Let 7 0 + 7 iX + 卞 2 入 2 + • • • be an ordinary power 
series with radius of convergence r. Then the power series (23) 
converges for every linear transformation A whose characteristic 
roots pi satisfy \ pi\ < r. 

Proof. We choose a coordinate system relative to which the 
matrix of A has the classical canonical form 

'(«i) ' 

(戊 2) 


L (a h )i 

where each diagonal block has the form 


PJ 

p a characteristic root. Evidently the matrix of A m has the same 
block form as that of A. Moreover the block that is in the same 
position as (24) is 


(24) 


P 


P 


P 
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This is immediate if we write (24) as pi + z where 


0 

1 0 
1 0 

Z = I 


and we note that 


0」 



etc. Hence if ^(X) denotes the 々 th partial sum of 汐 ( 入 ）=To 
+ Yi 入 + 72 入 2 + ••• j then a typical block of the matrix of 
S k (J) is 


S k ( P ) 

S k \p) 

S k /f ( P ) 

2 ! 


0 

^k(p) 

S k \p) 


0 


A(p) 
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If I p I < r, S k (p) y <SV(P)，• • • converge to S(p) y S\p) y • • • ， respec¬ 
tively. Hence the matrix sequence determined by con¬ 

verges to the matrix with typical diagonal block 

0 - 
S(p) o 

y(p) J(p) • 


(25) 


S\p) 

S"(P) 

2! 


Consequently [S^A)) converges. 

An important special case is the exponential function 

exp A = \ -\- A A 2 1 ! + • • • 

which is defined for all A. A matrix of exp A has the diagonal 
block form with blocks 

exp p ' 

exp p exp p 
exp p 

exp p exp p • 


This formula can be used to calculate det (exp A). We find that 

det (exp A) = exp p x exp p 2 ••- exp p n = exp (2p t ) 

where pi, p 2 , • • p n are the n characteristic roots. Hence 

(26) det (exp A) = exp (tr A) 

where tr A as usual denotes the trace of A. 

Power series in A are particularly easy to handle if J is a nor¬ 
mal linear transformation; for in this case we can find a unitary 
basis for our vector space such that the matrix of A has the 
canonical form 


(27) 


diag {pi ， P 2 ， …， Pn 
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Then if S ( 入 ） = 7 0 + 7i 入 + 72 入 2 + … is a power series with 
radius of convergence r > \ pi\ y i = l y 2 y • • - y n y S{A) is defined 
and this linear transformation has the matrix 

diag {S(pi) y S(p 2 ) y • • •, S(p n )} 

relative to the given unitary basis. Since s{A) has a diagonal 
matrix relative to a unitary basis, this transformation is normal. 
If U is unitary, the pi in (27) are of absolute value 1. Hence 

Pi = exp —Idiy di real. Let H be the linear transformation 
with matrix 

diag \e u e 2y - - e n } 

relative to our unitary basis. Then H is hermitian，and our con¬ 
siderations show that 

(28) U = exp {iH). 

This result in conjunction with the polar factorization shows that 
every linear transformation has the form 

(29) A = P exp (iH) 

where P is a (positive) semi-definite hermitian transformation 
and H is hermitian. This factorization obviously generalizes the 
factorization a = \ a \ exp (irj) y y\ real, of any complex number. 

EXERCISES 

1. Prove that a linear transformation A is positive definite hermitian if and 
only \i A — exp H for some hermitian H. 

2. Show that, if the characteristic roots of A are of absolute value <1， then 

log + A) = A — J 2 /2 + yf 3 /3 - is defined. Prove that exp (log (1 + A)) 

=1 + A, 

3. Prove that y# —> 0 if and only if all the characteristic roots of A are of 
absolute value less than 1. 

4. Prove that the sequence of powers {A k } of A possesses convergent sub¬ 
sequences if and only if 1) | p | ^ 1 for every characteristic root p and 2) the 
elementary divisors corresponding to the roots of absolute value 1 are simple. 
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In this chapter we consider a process for forming out of a pair 
consisting of a right vector space 9?’ and a left vector space 
a group X @ called the direct product of the two spaces. The 
product 沉 ’ X © is a commutative group，but in general there is 
no natural way of regarding this group as a vector space. Our 
process does lead to a vector space if one of the factors is a two- 
sided vector space. We define this concept here, and we remark 
that, if A = $ is a field, then any left or right space can be re¬ 
garded, in a trivial fashion, as a two-sided space. This leads to 
the definition of the Kronecker product of two vector spaces over 
a field. We also discuss the elements of tensor algebra, and we 
consider the extension of a vector space over a field 中 to a vec¬ 
tor space over a field P containing Finally we consider the 
concept of a (non-associative) algebra over a field, and we define 
the direct product of algebras. 

1. Product groups of vector spaces. A bilinear form g{x y y r ) 
connecting a left space and a right space may be regarded as a 
type of product of pairs of vectors, one chosen from each space, 
giving a result g(x y y f ) in A. The basic properties of this prod¬ 
uct are the distributive laws and the homogeneity: 

(1) g{oLX,y r ) = ag(x,y f ) y g(x y y f a) = g(x, y f )a. 

The fundamental concept of the present chapter is that of another 
kind of a product that we shall now define. 

Let 9? / be a right vector space and @ a left vector space over 

the same division ring A. Let 乘 be a commutative group (opera- 
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tion written as +) and suppose that, for each pair of vectors 
x’ ， y ， x’ y e ©，there is associated a unique element x f X 
y Then we shall say that $ is a product group of dt ; and © 
relative to the product X if 

1. (xi + x 2 f ) X y = xi X y + x 2 f X y 
〆 X Oi + j 2 ) = ^ X yi + x ; X jy 2 . 

2. x f a X ^ X ay. 

3. Every element of ^ has the form Xx/ X yi. 

We remark first that a non-zero bilinear form is a product of 
the present type if and only if △= 中 is commutative. Thus if 
we adopt the present notation and write x f X y for g(y y x r ) y then 

by ⑴， 

x f X ay = a(x r X y) y x f a X J =(〆 X y)a. 

On the other hand, x f X ay = x r a X y- Hence 

oc{x f X y) = (x ; X y)a. 

Now if the form is not the zero form, then it takes on all values 
in A. Hence the above equation shows that A is commutative. 
The converse is clear. 

We shall give next a way of forming a product group for any 
pair of vector spaces and ©. We take first a left vector space 
dt dual to dt f y and we suppose that this duality is given by the 
non-degenerate bilinear form g(x y y f ) y x y ; e For value 
group $ we take the group S(9?，©) of linear transformations of 
dt into ©. Finally we define x f X y for x f in and j in © to 
be the linear transformation 

( 2 ) ^ ^)y- 

Then 1. and 2. are immediate. Also we have seen (Chapter V, 
§ 5) that any linear mapping of 9? into © has the form 

(3) x x/)yi. 

Hence according to our definition it is a sum 2^/ X y%- This 
proves 3. 
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For any product we can prove as usual the rules : 

0Xjy = 0 = ^ ,/ X0 

( 一 〆 ）Xjy = — X y) = x f X (_jv). 

Suppose next that (/i, fzy * • * ^ fm) is a basis for ©• Then any 
y = ^0ifi and hence x f X y = ^x r X &iji = X fi- It fol¬ 

lows that any element of ^ can be written in the form 2^/ X/i. 
Similarly, if (e/ y e 2 ’ ， ••• ， e n f ) is a basis for 況 ’， then any element of 
^3 can be written as 2^ / X jy t * in ©. We shall call $ a direct 
product of 況 ， and © if uniqueness holds for each of these ways of 
writing an element. A somewhat better way of putting this is 
the following. The group ^ is a direct product of dt f and © rela¬ 
tive to X if 

4. (a) 'Ex/ X = 0 implies that either the yi are linearly de¬ 

pendent or that all the x/ = 0; 

(b) 'Zx/ X yi = 0 implies that either the x/ are linearly de¬ 
pendent or that all the jy» = 0. 

The group S ( 況 ， ©) is a direct product in this sense. Suppose 
that 2at/ X yi = 0. Then by definition of the product this 
means that x/)yi = 0 for all x. If the yi are linearly inde¬ 

pendent ， we have g(x y x/) = 0 for all x. Hence by the non¬ 
degeneracy of the form, x/ = 0 for all i. On the other hand, 
suppose that the x/ are linearly independent. Then we know 
that we can find a set of Xi such that g{xj y x/) = dji ， Then every 

yj = ^i)y% = 0 - 

A direct product of Si 7 and © is the ‘‘most general” kind of 
product of these two spaces; for we have the following 

Theorem 1. Let ^ be a direct product of and © relative to 
X and let be any product of these same spaces relative to the 
multiplication Xi. Then the mapping Xx/ X yi 2^/ Xiyi is 
a homomorphism of ^ onto 

Proof. Suppose we have two ways of writing an element 
2 8 ^ as a sum of products. We can suppose that these are 

2 = x x i Xyi = H ( — x/) X yj. Then X jy* = 0. Let 

i ”i+i i 
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us express the yi in terms of a set of linearly independent ele¬ 
ments f ly / 2> * * *, /r (a basis，for example). Then yk = ^a k ifi 
and 

0 = Xxk X yk = ^2 Xk X ^2 oLufi 

k l 

=S (S Xfb 


Hence = 0 for / = 1，2， . . •，r. This implies that in 队 

we have the relation 石 X i/z = 0. By retracing the 

steps we can conclude that Xijy/b = 0 in Hence the 


Q 


two formally distinct images X x i Xi jy^ and X (一 O X i yj of 

1 m + l 

% are equal. This, of course, means that the correspondence 


/ X yi —> 2^/ Xiyi 

is single-valued. It can now be verified directly that this map¬ 
ping is a homomorphism of ^ onto 

Suppose now that too, is a direct product. Then the argu¬ 
ment that we have given shows that 2^/ Xiyi = 0 implies that 
2^/ X y% = 0. Thus the kernel of the homomorphism is 0， and 
hence the homomorphism is an isomorphism. This proves 

Theorem 2. If ^ and % \ are direct products of and then 
the “natural” mappingXxi Xyi 2^/ Xiyi is an isomorphism. 

This result shows that there is essentially only one direct prod¬ 
uct of two given vector spaces. We may therefore speak of the 
direct product and we denote this group as 況 ， X ©• 


EXERCISES 

1. Write any vector in 9?' as an wi X 1 matrix and any vector in © as a 1 X «2 

matrix. Let scalar multiplication in 9? / and @ be respectively right and left 
multiplication of coordinates. Show that the group of ri\ X matrices is a di¬ 
rect product of 9?' and © relative to 〆 X J the ordinary matrix product. 

2. Show that either of the conditions in 4. implies the other. [Hint: note that 
only one of these is used to prove Theorem 1.] 

2. Direct products of linear transformations. We shall now 
consider an important generalization of Theorem 1. As in that 
theorem we let 乘 = 況’ X but for the second group we now 
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take any product Oi of the right space U 7 by the left space S? 
(both over A). Suppose A f is a linear mapping of 況’ into U’ and 
5 is a linear mapping of © into 33. Then we assert that the 
mapping 

(4) X jz 〜 {A’ XiyiB 

is a homomorphism of ^ into Oi. The proof is obtained by re¬ 
peating the argument used to prove Theorem 1. Thus, we have 
to show that a relation X yk = 0 implies H/XkA f Xi ykB = 0. 
As before, we write y k = ^ockifi where the /’s are independent. 
Then we obtain y Exj c f aki = 0 . Hence also 2 ( 々 ’/’) 咖 = 0 by the 
linearity of A f . Then 

0 = S {^k^ r )oLki Xi/A f Xi S aja(fiB) 

k k i 

= 23 Xi ^2,ykB 

k k 

by the linearity of B. The rest of the proof is an exact repetition 
of the previous one. 

Theorem 1 is obtained from the present result by specializing 
U 7 = 9?^ 35 = ©, A f = 1, B = \. Another important special 
case is that in which U’ = 況’， S3 = © and O x = Here we see 
that, if A f is any linear transformation in 況 ， and B is any linear 
transformation in then the mapping defined by (4) is an endo¬ 
morphism in the direct product 屯. We shall call this the direct 
product of A f and 5, and we denote it as A r X B. It is immediate 
from the definition that the direct product X 5 is distributive: 

(5) {A x f + A 2 f ) X B = X B + X B 

A f X {B x + B 2 ) = X X B 2y 

and that 

(6) X B)(C XD) = A r C X BD. 

If we now use 1’ to denote the identity mapping in 沉 ， and 1 
that in then clearly 1’ X 1 is the identity in 乘 • We note also 
that by (6) any A f y, B can be factored as 

(7) ， X £ = (，X 1)(1， XB) = (V X B){A f X 1). 
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EXERCISES 

1. Let S(9?, ©) be the group of linear mappings of 況 into @ and regard S as a 
product of 況 ， and © in the manner defined in § 1. Show that, if A' is a linear 
transformation in 9?’ and 5 is a linear transformation in then the mapping 
^ X 5 in 8 = 9{ / X © is identical with L ALB where L is a general element 
of 2 and A is the transpose in 9? of A,• 

2. Let $ = 9?’ X © and let 9K be the totality of endomorphisms HAi X Bi 

where Ai is a linear transformation in 況 ， and Bi is one in ©. Show that 99? is a 
subring of the ring of endomorphisms of ^ ^ X 

3. Show that the subset of elements of the form V X 5 is a subring of 2)? iso¬ 
morphic to S(@, ©) and that the subset of elements of the form yf’ X 1 is a 
subring isomorphic to S($K , , 9?’). 

3. Two-sided vector spaces. The process that we have given 
of “pasting together” two vector spaces to form their direct 
product has the serious defect that the final result is not a vec¬ 
tor space but only a group. To get around this difficulty we are 
led to consider two-sided vector spaces instead of the one-sided 
ones that we have studied hitherto. We define such a system to 
consist of a commutative group 9?, a division ring A, and two 
functions ax and xa which satisfy the conditions for left and 
right scalar multiplication respectively，and that, in addition ， 
satisfy the associative law 

( 8 ) (ax)^ = a(x^) 

for all a y ^ e A and all x edt. Thus our assumptions are that dt 
is at the same time a left and a right vector space and that any 
right (left) scalar multiplication is a linear transformation in 況 
regarded as a left (right) vector space. 

If △= 中 is a field，any right vector space can be regarded as 
a left vector space. One merely has to set xa = ax. Hence in 
dealing with vector spaces over fields we can suppose that all of 
these are left vector spaces. On the other hand, we can also 
consider these vector spaces as special types of two-sided spaces 
in which the left multiplication and the right multiplication de¬ 
termined by any a e A are identical. This “trivial” type of 
two-sided vector space is the one that will be our main concern 
in the remainder of this chapter. It is not difficult to construct 
other, non-trivial，types of two-sided vector spaces. We give one 
example here. 
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Example. Let be an w-dimensional left vector space over a field and let 
(eiy e 2 y • • • ， f n ) be a (left) basis for 9?. Let Si, 6 * 2 ，• • • ， *S* n be automorphisms in 
中 and define the right multiplication by a 8 ^ to be the linear transformation 
in the left space 9 ? defined by the matrix 

diag a S2 y • • •, a Sn }. 

Then aa = a Si ei and (X^e t )a = X^a Si ei ， Since 

ei(a + jS) = (a + = a Si ei + ^ Si ei = eia + 

ei(a^) = (aff) Si ei = a Si ^ Si e% = a Si {eifi) 

=(a 5 Vi)/3 = (^ t a)/3, 
e{\ — 

9? is a right vector space over Since the right multiplications are linear 
transformations in 9? as left space, (8) holds. Hence 況 is a two-sided vector 
space. 


Suppose now 況 is any two-sided vector space over a division 
ring A and © is a left vector space over A. We can form the 
direct product ^ = 9? X © obtained by regarding 9? as a right 
vector space. Since the mapping % —> is a linear transfor¬ 
mation in regarded as a right vector space, we know that the 
mapping Xxi X yi ^ XaXi X Xi e dt y yi e ©, is an endomor¬ 
phism in We now set 

(9) a2xi X yi = ^2aXi X 

and we can verify that, relative to this scalar multiplication, ^ 
is a left vector space over A. 

We shall now show that the (left) dimensionality dirtii ^ is 
the product of the left dimensionality of 9i and the left dimen¬ 
sionality of ©. Thus, let (e\y e 2y • • •, e n ) be a left basis for 9J and 
let (/i，/ 2 ，• • .，/w) be a left basis for ©. Any x can be writ¬ 
ten as and any j e © can be written as Hence 

a; X jy = X rjj/j = 2(^*)^- Xfj 

=Z) 2 xfj. 

3 i 

On the other hand, the vectors X) belong to 9?. Hence 

i 

we have ^ = D Hence 

i k 


-X^ = Z(EM^)X/ y = gM^X/,) 
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This proves that any vector in 氾 is a left linear combination of 
the vectors ei X Jj. Suppose next that X /；) = 0. Then 

0 = 2(7 ^a) Xfj = ?(? X fj- Since the /'s are lin¬ 
early independent，this gives = 0 ; ) = 1 ， 2 ， . • 、 


m. 


Hence each 7 " = 0 . 

A similar discussion applies if 9? is a right space over A and 
©is two-sided. Here *i)3 = 9? X © can be turned into a right 
space over A by defining 


(10) (Zxi X yda = Xxi X yioi. 

Also the product relation for right dimensionalities holds. 

If both 9 ? and © are two-sided vector spaces over A, then by 
using ( 9 ) and ( 10 ) we can convert ^ into a left and a right vec¬ 
tor space over A. As we have seen，any left multiplication de¬ 
fined in this way commutes with any right multiplication. Hence 
乘 is a two-sided vector space. 

It is natural to define a linear transformation of one two-sided 
vector space 9 ? into a second one © to be a mapping of 9? into @ 
which is linear for the left vector spaces 9 ?， @ and is linear also 
for the right vector spaces 9 ?， ©. Similarly ， 9 ? and © are con¬ 
sidered as equivalent if there exists a 1—1 linear transformation of 
況 onto ©. 

Suppose now that dt, 0 and X are three two-sided A-spaces 
and consider the two-sided space 9? X (© X J) where the X here 
indicates the direct product regarded as a two-sided space in the 
manner indicated. It is clear that any element of this space has 
the form Hxi X (ji X Zi) y Xi e yi e %i e X. Similarly any 
element of (9? X @) X 2 has the form 2(^- X yd X We now 
wish to show that the rule X (ji X Zi) 2(*v z . X yi) X Zi 
defines a 1-1 linear transformation of X (© X J) onto (沉 X 0) 
X T. For this purpose assume that we have a relation Xxi X 
(ji X = 0 in X (© X X). Then we can write Xi = 2 勺 0 ^ 
and Zi = ^^ikgk where the e y s are right linearly independent and 
the《’s are left linearly independent. If we substitute in our rela¬ 
tion we obtain 

0 = > : €j X > : i X = > : €j X > : i X ^i) • 
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Hence ^ oijiyi X Zi = 0 for j = 1 ， 2 ， • • •• Then 
% 

0 = Z (ajiyi)p ik X gk = (ocjiyi)p ik X gk- 

i,k k i 

Hence = 0 for all k. Thus [ 0 Lji{yS ilc ) = 0 and 

i % 

this in turn implies that 

0 = Z g X 2 ^ji{ySik) = Z) ("2 Wi) X y^ik 

j i i V j / 

= S X ySik- 

i 

Similarly this relation yields the relation X y%) X Zi = 0. A 
direct verification now shows that the correspondence 

X (yiX X yi) X Zi 

is a linear transformation of 5R X (© X $) onto (5R X ©) X X. 
Moreover, by symmetry, the kernel of this mapping is 0; hence 
it is an equivalence. Because of this equivalence we need not 
distinguish between the two direct products 9? X (© X J) and 
($R X @) X 2. We therefore use the notation 3J X © X J for 
either of these products, and we shall call this space the direct 
product of the three spaces 況 ， Also we write x X y X z 
for either of the products x X (y X z) or (x X y) X z. 

In a similar fashion we can define direct products of more than 
three two-sided spaces: Any two direct products obtained by 
taking 況 ，…， U in this order and associating the factors are 
equivalent under a natural equivalence of the type given for three 
factors. We can therefore denote any of the resulting product 
spaces as X © X • • • X U. The product of vectors in this space 
will be written as ^ X jy X • • • X 

EXERCISES 

1 . Let a —> be an isomorphism of the field 中 into itself and let 9? be a left 
vector space over 中 . Define xa — a s x and verify that this turns 況 into a two- 
sided vector space. Show that if the subfield of image elements a s is properly 
contained in 伞 ， then the left and the right dimensionalities of over $ are dif¬ 
ferent. 

2. Let 5R be a two-sided vector space over A such that the left and the right 
dimensionalities over A are finite and equal. Prove that there exists a set of 
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vectors e\ y 〜 which is at the same time a left basis and a right basis for 

over A, 

@ X 9i be defined as in Ex. I with S an automorphism in ^ and let @ be a 
vector space ofth i s type dehned by the automorphism T. Show that, if^T 
TS, then 況 X @ is not equivalent to @ X 9i. 

4. The Krot5ecker product. In the remainder of this chapter 
we shall suppose that A — $ is a field. Moreover, we shall be 
interested only in one-sided spaces and we shall write all of these 
as left spaces. The conjugate space of a space dt will be denoted 
as usual as but this, too, will be regarded as a left vector 
space. 

Suppose now that 況 and © are two spaces over We con¬ 
sider di and © momentarily as two-sided vector spaces in the 
trivial way that ax = xa for all a and x，and we form the direct 
product 5R X ©. This is a two-sided vector space, too, but of the 
trivial sort since 

a(^Xi X yi) = 'SaXi X y% = X Ji = X ocyi 

=Xxi X yioL = 2(a X yi)oi- 

Hence we may regard 況 X © simply as a left vector space. The 
(left) vector space thus obtained is called the Kronecker product 
of 9? and ©• Of the equations above, the significant ones from 
the point of view of left vector spaces are 

aiTtXi X jyi) = 'SaXi X yi = X ayi. 

Thus, the space 況 X © is characterized by the following proper¬ 
ties: There is defined a product ^ X jy e X © for every x edt 
and v e © such that 

V. (xx + x 2 ) X y = xi X y + x 2 X y 
x X (ji + y 2 ) = x X yi + x X y 2 - 

2’. a(x X y) = ax y, y = x y. ay. 

3’. Every element of 況 X © is of the form 'Exi X Xi e dt y 
yi e ©. 

4’. (a) 'hxi X = 0 implies that either the yi are linearly 

dependent or all the Xi are 0. 

⑻ Xxi X yi = 0 implies that either the Xi are linearly 
dependent or all the jy* are 0. 
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The foregoing discussion has established the existence of the 
Kronecker product of any two (finite dimensional) vector spaces.* 
Most of the results which we have obtained are applicable in the 
present situation. In particular，we recall that dim (況 X ©)= 
dim 9? dim ©. We shall now show that this equation can be used 
as a substitute for the independence conditions 4'; for we have 
the following 

Theorem 3. Let 9?, © and ^ be vector spaces over a field 电 and 
suppose that there is defined a product x X y y x e e^> y x X jy e 乘， 
such that r. ， 2 '. and hold. Then ^)3 is a Kronecker product of 
5K and © if and only if dim% = dim 5R dim ©. 

Proof. The necessity of this condition has already been proved. 
Conversely, let dim ^ = dim 沉 dim ©• Let (^i, e 2y • • • ， e n ) be 
a basis for 況 and let C/i ， / 2 ，• • . ， /w) be a basis for ©. Then it 
follows easily that the vectors ei X/y are generators of Since 
their number is nm y they constitute a basis. Now suppose that 
eiy e 2y … y e r are any linearly independent vectors in 5R. Then 
we can suppose that these are part of a basis for 9?. If 2^- X y% 
= 0， we can write and we obtain 2)8^^ X fj = 0. 

Hence each 〜 = 0, and this means that each = 0. In a simi¬ 
lar manner we establish the second independence condition. 

We have seen that direct multiplication of two-sided vector 
spaces is associative and, in particular, this holds for Kronecker 
products. Thus, if 況 ，© and X are three vector spaces over a 
field, then we have the natural equivalence Xxi X (ji X Zi )—> 
2(^1 X yd X Zi of 5R X (© X 2：) onto (9J X ©) X X. We there¬ 
fore identify these two spaces and we identify the elements 
X (y% X and X yd X Also as before we may 
simplify our notation and write 9? X © X $ and x X y X z. 
More generally we can define the Kronecker product 況 X © X 
• • • X U of any finite number of spaces and denote its elements as 
XxXy X--Xu. 

Direct multiplication of two-sided spaces is not in general com¬ 
mutative (cf. Ex. 3, p. 208). However, in the special case of 
Kronecker products the commutative law does hold. In fact, we 

* As we shall see in Chapter IX， it is easy to carry this over to infinite dimensional 
spaces. 
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can show that the rule Xxi X y% X Xi defines an equiva¬ 

lence of 況 X © onto © X The proof of this result follows the 
pattern of our other proofs : By expressing the Xi and the in 
terms of linearly independent elements we can show that Xxi X 
y% = 0 holds if and only if X Xi = 0. The remainder of the 
argument is a verification. More generally the Kronecker prod¬ 
uct 0? ⑴ X 況 ⑵ X • • X is equivalent to 沉⑹ X 沉⑹ X • • • 
X dt Ua) for any permutation (j u j 2> • - -J s ) of (1， 2, • • .，J). The 
mapping 2^- (1) X ^- (2) X • • • X Xi (s) -» ^Xi Ul) X Xi (h) X ... X 
Xi ja) is an equivalence. 

The notion of the Kronecker product of vector spaces leads to 
the definition of the useful concept of a free (associative) algebra. 
To define this concept we begin with an arbitrary vector space 
dt over a field 中 and we introduce the Kronecker products 
= 9? X X • • • X (i factors). Also we adopt the convention 
that 9?。 1 = 況 and 況 o 0 = $; hence 9V is defined for all i = 0, 1, 
2， • • • • By the above remarks on associativity X == 
if i y j > L Hence any W) e x ij) z dt 0 j determine a 
vector x (i) X x U) of 9? 0 ' +y . If either i = 0 or j = 0, then we 
define ⑷ X at 。）to be the product of (or x (i) ) by the field 
element ⑷ (or We now form the direct sum % of the spaces 

This space can be defined to be the set of sequences x = 
(*v (0) ， 尤⑴， x {2 \ • • •) where x (i) and %“）= 0 for / sufficiently 
large. We consider x = y = (J (0) ，JV (1) ， y {2 \ • • •) if and only if 
x^ l) = jy (l ) for all /. For arbitrary x and y we define 


(ID 


x y = (% ⑼ +jk ( 0 )， ⑴ + j ⑴， • • •） 
ax = ⑴， ax^ 2 \ • • •)• 


Then it is clear that g is a vector space. If we identify the vec¬ 
tor (0^ •••，（)， ％⑴，0， • • •）with 尤⑴， then any vector in g can be 

oo 

written in one and only one way as where x (i) = 0 for i 


sufficiently large. If the ij are distinct and x (ii) 9 ^ 0, then these 
vectors are linearly independent. It follows that，if 況〆0, then 


5 is infinite dimensional. 
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We now introduce a multiplication X in g by defining (Sat ⑴） 
X = 2z ⑻ where 

(12) 2 ⑻ = ⑼ X j (幻 + %⑴ X —” +.. • + ⑷ X jy (0) . 

It is easy to verify that % is an associative algebra. We shall call 
this algebra the free {associative) algebra based on the vector 
space 5R. 

EXERCISES 

1 . Show that, if is a one-dimensional space, then % is essentially the poly¬ 
nomial algebra in one indeterminate (transcendental element) over 中 . 

2 . Let § be the free algebra based on an n dimensional vector space 況 and let 
S3 be the (two-sided) ideal in § generated by the vectors x'Ky —and j 
in 9?. Show that is essentially the polynomial algebra in n algebraically in¬ 
dependent transcendental elements. 

3. Let % be as in Ex. 2. Assume the characteristic of 〆 2 and let S be the 

ideal in % generated by the vectors ^ X ^ ^ X x y y in 9?. Then is 

called the Grassmann {or exterior) algebra based on 3t. Show that dim §/S = 2 n . 

4. If 況 ， •••，!! are vector spaces over 中 ， we define a multilinear function on 
況 ，@，…， U as a function f(x, j，•••，《)，x e 浼 ， j e ©，• • •, « 8 U, with values in 

such that/ is a linear function of any one of the arguments for fixed values of 
the remaining ones. Show that this concept is equivalent to that of linear func¬ 
tion on X © X • • • X U by proving: 1) if/is multilinear, then X X ... X 
Ui —> • • •, Ui) is an element of the conjugate space of 況 X © X ... X U; 

and 2) if/is a linear function on SR X © X • • • X U, then the contraction of/to 
the subset of vectors of the form x X y X' •• X u \s a. multilinear function. 

5. Let g(x), h{y)^ •••, k{u) 8 9J*, ©*, • • •, U* respectively. Show that 
f(x,y 9 ...，《) 三 g{^)Ky) - - - k{u) is multilinear. Let / also denote the associated 
element of (9J X @ X • • • X U) * and show that the rule 'Eg X h X - •• X k —> 2/ 
defines an equivalence of 5R* X ©* X • * * X U* onto (9? X © X • • • X U)*. 

5. Kronecker products of linear transformations and of ma¬ 
trices. If is a linear transformation in 9? and B is one in 
then we know that 'Exi X yi ^XiA X y%B is a group homo¬ 
morphism in 況 X ©. It is evident also that this mapping com¬ 
mutes with the scalar multiplications; hence it is linear. We 
shall call this mapping the Kronecker product A Y. B oi A and B. 
In a similar manner we can define the Kronecker products A X 
5 X . • • X Z) of a number of linear transformations. We shall 
now show that, relative to Kronecker multiplication, the vector 
space 2(JR X ©， 況 X ©) of linear transformations in 9? X © is a 
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Kronecker product 2(9?， 況） X S(©，©)• Equation (5) shows that 
the distributive laws hold. Also 


(x X y){a{A X B)) = {xA X yB)a = {xA)a X yB 

=x{Aoi) X yB. 


Hence a{A X 5) = aA X B and similarly a{A X B) = A 乂 aB. 
Next let (e ly e 2y • . •， e n ) be a basis for 況 and (/i，y* 2 ，• • .，/m) a 
basis for Then the nm vectors ei X /y form a basis for 9? X ©• 
Let Eu ，、 jj ，be the linear transformation in 5K X 0 which sends 
d X fj into X fy and sends the remaining X/i into 0. Then 
we can verify that 


(13) 


Eii r ,jj' 


E iV X F. 


3J' 


where Eu> is the linear transformation in 5R which sends ei into 
e? and the remaining e’s into 0 and Fjy is the linear transforma¬ 
tion in © which sends fj into fy and the remaining/^ into 0. It 
follows that every element of 2( 況 X 況 X ©) has the form 
lliAi X B iy Ai e 9i), Bi 6 S(@，©)• Since dim X ©， 況 
X ©) = { mn ) 2 — dim 8( 況，況） dim S (©，©)， our assertion follows 
from Theorem 3. We have therefore proved the following 


Theorem 4. If 9? and © are {finite dimensional) vector spaces ， 
the space 8(沉 X 況 X ©) = S(9?，9i) X 2(©，©) relative to Kro¬ 
necker multiplication of linear transformations. 

Assume now that 


(14) eiA = f k B = 'h&uji 

so that (a) and ⑻ are the matrices of A and B y respectively, rel¬ 
ative to the chosen bases. Then we have 


(15) (ei X fk){A X B) = XaijPkiej X/i. 

We shall arrange the vectors X fk lexicographically as 

(^i x • • • ， ^1 x g x y*i，• • • ， G x yin; . • •; • • • ， 〜x 

and we shall call this ordered basis the one associated with 
•••， e n ) and (/i， / 2 ，…， 7m). Equation (15) shows that the 
matrix oi A Y, B relative to the associated basis is 
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• OLn^im 

• • 

^12^11 • • • a 12Plm 

• • 

* ^ 1 1 m 

• 

• • 

^1 * ^1 l(^mm 

• • 

參 

«210n • • • 

• • 

0^22^11 • • • OL22&lm 

• • 

* ^2n^lm 

• 

• • 

• 參 

^22^ml * ^22^mm 

• 

* ^2n^mm 

• * 

• * 

參 • 

• • 

• • 

• • 

• 

• 

• 


We denote this matrix as (a) X ⑹ and we shall call it the 
Kronecker product of the two matrices (a) and (jS). 

The basic rules governing Kronecker multiplication of linear 
transformations have their counterparts for matrices. In par¬ 
ticular the preceding theorem shows that the space of nm X nm 
matrices over <J> is the Kronecker product of the space of n 乂 n 
matrices and the space of m X m matrices relative to <I>. Also, 
we know that {A X B)(C X D) = AC X BD holds for linear 
transformations and this leads directly to the matrix rule 

(16) ((a) X ⑹ ）（ (7) X ㈤） = (a)( 7 ) X ⑹ （5). 


EXERCISES 

1 . Show that the matrix oi A B relative to the basis (ei X/i, X/i, • • •， 

e n X/i ； e\ X/2, X/2, •••，〜 X/2; …；…〆 n X / 饥 ） is ⑹ X (a). Hence 

prove that (/3) X («) is similar to (a) X ⑹. 

2. Prove that (a) X ((j8) X ( 7 )) = ((«) X (/3)) X ( 7 )* 

3. Prove that if p is a root of the characteristic polynomial of A and a has 
this property for B then pa has the property for A B. 

4. Prove that det (yf X 5) = (det y/) m (det B) n . 

6. Tensor spaces. If 9J is a vector space and 5K* is the conju¬ 
gate of then any Kronecker product space 況 X ... X 況 X 況* 
X • . • X 況* is called a tensor space based on the space 5K. The ele¬ 
ments of such a space, are called tensors ， and if there are r factors 
9? and s factors 況*， then we say that these tensors are contra- 
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variant of rank r and covariant oj rank j. We shall use the abbrevi¬ 
ated notation 9? s r for the space. Also，as in § 4， it will be con¬ 
venient to regard 中 as the tensor space 9? 0 0 of ranks 0. 

If {ei y e 2y • . •， e n ) is a basis in the base space 9i and e 2 , 
m ' 'y e n ) * is the complementary basis in 9i* in the sense that 

e 3 {e^) = Si J y 

the Kronecker delta, then the vectors 

(17) e h X 〜 X ... X 〜 X e jl X … X e js 

constitute a basis in the tensor space. We can write any vector 
in this space as 

(18) 2 泛 : ::;:〜 X ... X 〜 X / X … X A 

It is natural to give preference to bases of this type that are de¬ 
termined by the basis (e ly e 2y •••，〜）in 況 . The element (18) of 
the tensor space will be called the tensor whose coordinates are 
relative to the 0)-basis in If (/i，/ 2 ，• • .，/ n ) is a second 
basis in 況 and fi = 2 咖、 then 

e 5 = ^ v )fh f = 2 ^, e 3 = Xfiif 
where {v) is the inverse of the matrix (弘 ). Hence 

对 ; :::): 〜 X...X 〜 x^x...x/ 

^ ^J kl X … XA x/ 1 X … • x/' 

Thus our tensor has the coordinates 


(19) 


hi • •. Z* — 



relative to the (/) basis. 

We consider next a generalization of the concept of the transpose 
of a linear transformation. We recall that, if A is any linear 
transformation in 況， then the transpose of A is the mapping 
in 9 ?* where y*(x) = x^ixA). We shall now associ- 

. - r - 、 

ate with A the linear transformation Aj 三 A 乂…乂 A 乂 


A 、X • • • X It is natural to consider this transformation to be 
the transformation induced by A in the tensor space 9J s r . We 

* This notation is somewhat more convenient than our former one: (^i*, e2*, ..., e n *). 
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recall that, if (a：) is the matrix of A relative to the basis {e u e 2y 
…， ^n)y then (a：)’ is the matrix of relative to the complemen¬ 
tary basis (e 1 y e\ …， e n ). It follows that the matrix of A s r rela¬ 
tive to the natural basis (17) ordered lexicographically is the 

• - r - , I - s - , 

Kronecker product (a) X • * * X (a) X (a：)’ X • • • X (a) / . 

There is an important process called contraction for associating 
with any tensor which is contravariant of rank r > 0 and co¬ 
variant of rank ^ > 0 a tensor contravariant of rank r — 1 and 
covariant of rank s — l. We recall first of all that, if ^ e 9? and 
e 9?*, then the mapping (x y jy*) —> y^(x) is a bilinear form 
connecting 5R and 9?*. Since $ is commutative, this form de¬ 
fines a product of the vector spaces 況 and 5R* in the sense of § 1. 
Hence by Theorem 1 we know that the mapping Xxi X jVi* — 
is a homomorphism of 9?! 1 = 9? X 9?* onto the additive 
group 屯 Also it is immediate that our correspondence is a linear 
transformation of SRi 1 onto the one-dimensional vector space $ 
(= 況 o 0 ). 

The considerations of § 1 show also that，if © is a second vector 
space, then the linear mapping of 9?! 1 onto 9? 0 ° can be combined 
with the identity mapping in © to give a linear mapping of 9?! 1 
X @ onto 況 o 0 X ©• The resulting mapping is defined by the 
following rule 

'Sxi X y* X Zi X z iy 

Xi 8 yi* e 9?*, Zi e ©. It is easy to see that the space SK 0 ° X © 
is equivalent to @ under the mapping X Zi —> Hence 

we see that 

(20) ^Xi X X Zi 

is a linear transformation of 9?! 1 X © onto ©. 

The process of contraction is obtained by specializing @ to be 
the tensor space 9? s _i r_1 . This specialization shows directly that 
the mapping 

Zx Xy* X xi X … X x r -i X jyi* X y 2 * X … X i* 

-> ⑻ A X ... X ^r-1 X 力* X • • • X t 

t We have omitted the summation subscript here. It is understood that we have a sum 
of terms of the type indicated. 
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is a linear mapping of JKi 1 X 3J s _i r_1 onto 5R s r . Now let k be 
chosen in 1，2，…， r and / in 1， •••，Then we know that the 
mapping 

S^i X • • • X ^ X Ji* X • • • X -> 

2a X 力 * X X • • • X x k _i X ^+i X • • • X a X jVi* X … 

Xyi-i* X 力 +1 * X...X 

is an equivalence of dt s r onto 9?! 1 X 5K s _i r_1 . Hence the mapping 

(21) 2心 X … X a X 力* X . • • X j s * — 

^yi^{x k )xi X … X x k -i X x k+1 X • • • X X )，i* X … 

X^_ 1 * X Jz+i* X---X j s * 

is a linear transformation of di s r onto 9^—/—\ This mapping is 
called contraction oi dt s r with respect to the kth contravaricmt index 
and the Ith covariant index. 

We now employ a basis X • • • X e ir X e n X - X e Js in di s r 
and consider the tensor (18). Contraction with respect to the 
kth contravariant and the /th covariant index yields the tensor 

X • • • X X ^ +1 X . . • X 〜 X / X ••• 

X e il ~ l X e jl+l X . • • X 


Hence the coordinates of the contracted tensor relative to the 
basis determined by the (^)-basis in 9i are 

* * . 以一 1 以 +1 • . .V _ * * -ik-lQik+l - - 'ir 

*»ji • * * • •；« 一 V；l • - 'jl-iqjl+l - - 'js * 

Q 

The notion of contraction can be used to give a definition of 
the trace of a linear transformation which is independent of 
bases. We note first that the space 況） of linear transforma¬ 
tions in dt can be regarded as the tensor space 9?! 1 . This is clear 
from our construction of direct products，(§ 1). Thus, if ^ e 9f 
and y* e 3J*，then we have defined X jy* to be the linear trans¬ 
formation of 5R into itself that sends the vector u into y^{u)x. 
We kn6w that, relative to this definition of X， 2( 況，況） = 況 X 
Any element of 2 can be written in the form 2^^ X Ji*. Now the 
contraction which we have defined is a linear mapping of 2 into 
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中 which sends 'Sxi X into We shall now show that 

this mapping coincides with the mapping A tr A defined by 
bases for 9?. 

To see this, let (e ly e 2 , • • • ， e n ) be a basis for 沉 and write A = 
X e{. Then 

ejA = X 

i 

Hence the matrix of A relative to e 2y …， e n ) is (a) = 

Hence tv A = Hui ¥ {ei). This is the same result which is obtained 
by contraction. A change of basis yields a second matrix of A 
similar to (a). Its trace coincides with the contraction of the 
tensor. Thus, without verifying this fact by direct computation 
(as we have done previously) we see that similar matrices have 
the same trace. 

7. Symmetry classes of tensors. We consider in this section 
the space 9J 0 r of contravariant tensors of rank r. The elements 
of this space are the tensors 2^! X A X … X % r . Let i V 
be any permutation of the numbers 1，2，…， r. Then we know 
that the mapping 

X x 2 X - — X x r X X . •. X av 

is a (1—1) linear transformation in 9? 0 r - We shall call this trans¬ 
formation a symmetry in 9? 0 r . There is one of these associated 
with every element of the symmetric group © r on the r letters 
1，2， • • •， r. 1( a e we denote the associated mapping in 9t 0 r 
by P{<j). Then it is clear from our definition that 

(23) P(ar) = P{a)P{r). 

A linear transformation of the form Ha a P(a) where a a denotes 
the scalar multiplication by the element a ff is called a symmetry 
operator in 況 0 r . Because of (23) these operators form a subalgebra 
of the complete algebra of linear transformations in $R 0 r . If Q is 
a symmetry operator, then the set of vectors annihilated by Q is 
a subspace; more generally if [Q] is any set of symmetry opera¬ 
tors then the vectors z such that zQ = 0 for all is a subspace. 
We shall call such a subspace a symmetry class of tensors. For 
example, let the set \Q) be the totality of symmetry operators 
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P{p) — 1 = P((7) — P(l), <t e © r . A tensor in this symmetry 
class is symmetric in the sense that 

X ^2* X * * * X Xft = X ^2 X * * * X x r 

for any permutation i —> i f of 1，2 ， • • 、 r. Similarly if {Q} is the 
set of symmetry operators P{a) — € a where = 1 if a- is an even 
permutation and e ff = — 1 if o- is odd，then the set {Q} determines 
the class of tensors which are skew symmetric in the sense that 

X X • • • X 〜=X X • • . X 

for a: / — 厂. 

The symmetry operators are of particular importance in study¬ 
ing the linear transformations in 9? 0 r which are induced by the 
linear transformations in the base space 9?. If A is such a map¬ 
ping in we have defined the “induced” linear transformation 
Aj = y^X^X***X^by the formula 

(2a; i X ^2 X • • • X x r )^Q r = IhxiA X x 2 A X ... X x r A. 
Evidently we have the relation 
(24) (JB) 0 r = A 挪 • 

Since l 0 r = 1， if A has an inverse then = l 0 r 

=1. Hence if A is non-singular, then Aq is non-singular in the 
ring 2o r of linear transformations of 況 0 r . The equation (24) 
shows that the mapping A Aj is a homomorphism of the 
units of 2 in the group of units of ? 0 r « 

It is clear from the definition that commutes with every 
symmetry and hence with every symmetry operator Q. If zQ 
= 0， then also {zA 0 r )Q = 0. This remark shows that any sym¬ 
metry class of tensors is an invariant subspace relative to the 
totality of mappings of the form A 0 r . If U{A) denotes the linear 
transformation induced by Aj in a particular symmetry class, 
then by (24) we have the relation U(AB) — U{A) U{B). 

We shall consider now the special case of the symmetry class 
of skew symmetric tensors. We shall assume also that the char¬ 
acteristic of is not two. We determine first a basis for our sym¬ 
metry class. Let 

球 i2 …％ X〜X • • • X 〜 
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be skew symmetric. Then 

(25) 2 严 2 … X 〜 X • • • X 〜 …％ Xe i2 乂…乂 e ir 
and, since e^ -1 = this implies that 

(26) ^tiaV __ e git’2 … ir 


Hence an interchange of any two subscripts changes the sign of 
the component 炉 ll2 ". lr . As a corollary we see that 广 2 ." lr = 0 if 
any two of the ij are equal. In particular, \{r > n every ^ ll2 ** ，tr = 
0, that is, the only skew symmetric tensor of rank r > n is the 0 
tensor. Also we see that, whatever the value of r, the expression 
X • • • X 〜 for a skew symmetric tensor has zero co¬ 
efficients for each term e h X ^- 2 X • • • X e ir in which two ij are 
equal. Hence these terms can be dropped. We suppose next 
that ii < i 2 < • • m < i r - Then the coefficient 广 l2 ’ … w = e a ^ ll2 "* tr . 
Hence the terms involving all the base tensors e iv X e iv X … 
X e ir , add up to 

(27) f … 〜 ] ， i\ < i2 < ' < ir 

where 


(28) l e h e i 2 * * * e i^ = 23 € a e iv ^ e h' X • • • X 6^,. 

a 

It is clear that [e h e i2 - - - e ir ] is skew symmetric. Moreover, if 
ji <7*2 < <jr and {j u j 2 , • • •， ir) 〆 O.i，•••，&)，then 
[e h e h - - - <?y r ] involves a set of base tensors e h , X e h> X • • • X e jr , 
that has vacuous intersection with the set e iv X e iv X … X e ir ,. 
It follows that the vectors [e^e^ - - - e ir ] determined by all pos¬ 
sible choices of the indices /*i < /*2 < * • • < U from \ to n are 
linearly independent. Hence these tensors form a basis for the 
space of skew symmetric tensors. The number of elements in 
this basis is the same as the number of combinations of r distinct 
objects that can be selected from n distinct objects. This num¬ 


ber (:)is the dimensionality of our space. 

We arrange the vectors [e^e^ • • •〜]lexicographically with re¬ 
spect to the indices /i，/ 2 ，•••，，、• For example，if w = 3 and 
r = 2, the order is [eie 2 ] y [eie 3 ] y [<^ 3 ]. If (a) is the matrix of a 
linear transformation A relative to the basis (e^ e 2i ••• ， G )， 
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then the matrix relative to the lexicographically ordered basis 
[〜〜••• e ir ] y of the linear transformation induced by A in the 
space of skew symmetric tensors of rank r is called the rth com¬ 
pound of (a). We denote this matrix as C r (a). Evidently we 
have the relation 


(29) C r ((a)(^)) = C r {a)C r {&). 

We shall now obtain the explicit form of C r (a). Since eiA = 

^CX ， ij€ jy 

=X e a e iv A X e iv A X … X e^A 


(30) 






a 








J ^ 


z 




• • • X X • • • X 

叫 ri ， I (Gv X X • • • X fy r ，） 


where 




a { j denotes the determinant 


(31) 


^iijy 


參 • • 


^%23V 

• 

• 

• 

• 

• • • 

• • • 

• • • 

^hjr r 

• 

• 

• 

^irjv 

• 

^irJV 

• • • 

• • • 

• 


If any two fs are equal, this determinant is 0 and for unequal fs 

^irjr' — ^<r| ^*1 ； 1^12^2 °^irjr 

where j\ < j 2 < • • . < jr. Hence (30) can be written as 

[^tl^l'2 ~~ I ' * * ^irjr I J * 

Jl <32 < <jr 

This shows that C r {a) is the matrix whose elements are the r- 
rowed minors | 出 cx izh … a^ r | of (a). 

If r = w，the skew symmetric tensors have the basis [e^ - - - e n ]. 
The matrix C n (a) = det (a). Thus (29) specializes in this case 
to the multiplication rule for determinants. 
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These remarks will serve as an introduction to the rich but 
somewhat involved theory of symmetry classes of tensors. A 
thorough treatment of this subject is given in Weyl’s The Classi¬ 
cal Groups y Chapters 3 and 4. (Cf. also Wedderburn’s Lectures 
on Matrices ， Chapter 5.) 

EXERCISES 

1. Show that [x\X 2 - - - x n ] = Ze ff XvX 2 ^ - - - X nf = | fil 专 22 . • • fnn I ••- e n ] 
where | 专 11 •. • ^ n n | is the determinant of the coordinates of the x*s relative to 
the es. 

2. Show that, for the scalar matrix al, C r (al) = a r l. 

(n~l\ 

3. Prove that det C r (cc) = (det (a)) r_1 • 

8. Extension of the field of a vector space. If P is a field 
which contains 中 as a subfield，then P can be regarded as a vec¬ 
tor space over <J>. The addition in the vector space is taken to 
be the field addition，and scalar multiplication for a in 中 and 
f in P is defined to be the field product. The axioms of a vector 
space are immediate consequences of the associative and distribu¬ 
tive laws and the fact that $ contains the identity of P. The vec¬ 
tor space may be infinite dimensional or finite dimensional. For 
example，if P = 伞 ( 入 ) where 入 is an indeterminate, then P is in¬ 
finite over On the other hand, if P is the field of complex 
numbers and 中 is the subfield of real numbers, then P is two- 
dimensional over 

Now let 況 be a vector space over 中 and let $ = P X the 
Kronecker products of P regarded as a vector space over $ with 
the vector space The elements of 乘 have the form X Xi 
where pi e P and Xi e 5R. Let a be any element of P; then, since 
芒 — <7$ is a linear transformation in P over 中 ， the mapping 

X Xi — > X 

is an endomorphism. We use this to define a scalar multiplica¬ 
tion in ^ by setting 

(32) o-(2pi X Xi) = X Xi- 

* Strictly speaking the existence of the Kronecker product has thus far been proved only 
in the case in which P is finite over 中 . The considerations of Chapter IX will enable us to 
extend our construction to the infinite case. 
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Then we have shown that the function az is single-valued and 
that a(zx + z 2 ) = aZi + <tz 2 . The other axioms for scalar mul¬ 
tiplication can be verified directly. Hence 采 can be regarded as 
a vector space over P. We shall denote 犯 as and we call 
this space obtained from 況 by extending the base field $ to the 

field P. 

It is easy to see that the dimensionality of over P is the 
same as that of 況 over 伞 . For let (e u e 2y • • • ， e n ) be a basis for 
況 over $ and let ^ = 1 X Then X = p t (l X e t ) = p^i 
and，since any 2 e 9? P has the form 2p t - X e iy it also has the form 
2p^-. Similarly, if 石 = 0， then 2p» X 〜= 0 and，since the 
ei are linearly independent over every pi = 0. 

For each ^ 8 we set 无 =1 X Then it is easy to check 
that the correspondence x x is an equivalence between the 
vector space 況 over $ and a subspace ^ of 3ip over 中 . If we like 
we can replace the space 9? by the subset 沆 of 9? P . The relation 
between 9?p and 沉 can be described by the following statements: 


1. Any vector in 9? P has the form XpiXi where pi 8 P and Xi e 

2. If the vectors {e\ y e 2y • • • ， e n ) are in 9? and are linearly inde¬ 
pendent over 中 ， then they are also linearly independent over P. 

Suppose now that yf is a linear transformation in ?ft over 中 ; 
then we know that the mapping X Xi X XiA is an en¬ 

domorphism in 9?p. It is also immediate that it is a linear trans¬ 
formation in 9?p over P. We shall call this mapping the extension 
of A in dtp. We use the same letter to denote a mapping and its 
extension. If (a) is a matrix of A relative to the basis (e ly e 2} 
• • - y e n ) of SK, then 

eiA = (1 e^j A = 1 X CiA = 21 X 
=Sa^-(1 X ej) = 'Saijej. 

Hence the matrix of the extension A relative to the basis (e ly e 2y 
••• y e n ) is (a) also. 

9. A theorem on similarity of sets of matrices. In this sec¬ 
tion we shall prove a theorem on sets of matrices which is of 
interest in itself and which illustrates a useful method in the 
theory of matrices and of algebras. The idea of this method is 
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that it is sometimes easier to prove a result if the base field is 
“sufficiently large” (e.g” algebraically closed). We can, there¬ 
fore, extend the base field to obtain one which has the necessary 
properties and then we are confronted with the problem of show¬ 
ing that the final result is valid in the original field. 

The particular problem we shall consider is the following. Let 
coi and co 2 be two sets of matrices with elements in Suppose 
they are similar by means of a matrix whose elements belong to 
an extension field P. Then can we conclude that the sets are 
similar by a matrix with elements in 中？ 

More precisely, we begin with a set of linear transformations 
in 況 over and we consider their extensions in dt over P. Let 
co be the set of matrices determined by these extensions relative 
to a basis (e ly e 2y ••• ， e n ) y ?» = 1 X e{. As we have seen，the 
matrices in co all have elements in the field 伞 . If («i ， u 2y • • • ， u n ) 
is any basis in 況 p over P and Ui = then the set of matrices 

of Q, relative to this basis is (/x)co(/x) 一 1 • In general some of these 
matrices will have elements which do not belong to 少 . How¬ 
ever, it may happen that even though (/jl) the set 一 1 

C $ n . We shall now show that, if this is the case, then there 
exists a matrix ( 7 ) in L(^>, n) such that for every (a) e c*> 

( 7 )( a )( 7)~ 1 = ⑷⑹〜)- 1 . 

We shall prove this result under the assumption that 伞 has an in¬ 
finite number of elements.* 

Theorem 5. Let 龟 be infinite and let m be a set of matrices with 
elements in Suppose that (jjl) is a matrix in L(P y n) y P an ex - 
tension of such that (m)w(M) 一 1 Then there exists a matrix 

( 7 ) e L(^ y n) such that ( 7 ) (a)( 7)" -1 = (M)(a)(M) 一 1 every {a) 

8 0 ). 

Proof. Denote (M)(a)(/x) 一 1 as (a) M . Then 

(M) ㈤ =«(M) 

and these equations are equivalent to a system (possibly infinite) 
of homogeneous linear equations for the elements ^ of (/x). 

* A proof for the finite case is given in Deuring, Galoische Theorie und Darstellungstheorte^ 
Math. Annalen, v. 107, pp. 140-144. 
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Moreover, these equations have coefficients in 中， that is, they 

have the form … . ^ ^ 

= 0 ， in ^>. 


We regard the set { (尽) } first as a subset of ^ ny and we suppose 
that r is the rank of this set in the sense that this is the largest 
number of linearly independent (relative to 中） matrices in {(/5)}. 
Then the equations = 0 have n 2 — r linearly independent 

solutions for ^ in $ such that every solution is a linear combina¬ 
tion of these. Let (7 " (A) )，h = n 2 — r y bo, 

such a set of solutions. 

We remark next that a set of matrices with coefficients in $ 
that are linearly independent over $ are also linearly independent 
over P. This is clear since the space P n is the extension space $ n p. 
Hence the matrices (w (1) ) ， ••• ， (7ij( h) ) are P independent. We 
now note that r is also the rank of the set { (13)} relative to P and 
that the maximum number of linearly independent solutions of 
the equations in P is also n 2 — r. Hence the particular 

solutions (?y" ( 1 ) )， 0 r" (2) )， (7ij (h) ) which we selected form a 
basic set for the solutions in P. In particular 

IMj = "lD . ⑴ + + ••• + 

where the p’s are in P. 

We now replace the vi by independent indeterminates 入 and 
we consider the polynomial 

det (X \k7ij (k) y 

This polynomial in 到入 1 ，入 2 ，…，入 d is not the 0 polynomial since 
its value det (m) for 入 * = jua ： is not 0 . Since $ is infinite, we can 
select values X* = ft； in 中 such that det (2/5以以⑻） 〆 0.* Let 
W = 2/3以"⑻ and let (7) = (Tzi)- Then ( 7 ) e L(^ y n) and 
= 0 for all ) 8 . Hence 

(7) (a) = («) m (t) 

for all (a) y and ( 7 ) satisfies the requirements of the theorem. 


EXERCISE 

1. Prove Theorem 5 for co a set consisting of a single matrix without any re¬ 
striction on 中 . 

* See Theorem 10, p. 112, of Volume I of these Lectures. 
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10. Alternative definition of an algebra. Kronecker product 
of algebras. The concept of an associative algebra has been in¬ 
troduced in Chapter II. We shall now see that a simple alterna¬ 
tive definition can be given in terms of the notion of the Kro¬ 
necker product. We find it convenient to generalize the former 
discussion by dropping the associative law. Then our previous 
definition takes the following form: A {not necessarily associative) 
algebra 21 is a vector space over a field 中 together with a binary 
multiplication xy in 21 such that 

(33) (^i + x 2 )y = x x y + x 2 y y x(y x + y 2 ) = + xy 2 

(34) oi{xy) = {ax)y = x{ay). 

Conditions (33) and the last equality in (34) state that 21 is a 
product space of 21 and 21 relative to the multiplication xy. Hence 
we know that the mapping X jy — is a linear transfor¬ 
mation of the Kronecker product 21 X 21 into 21 . 

This remark serves as a basis for our second definition of an 
algebra. According to it we define an algebra to be a vector 
space 21 over a field 中 together with a linear transformation P of 
21 X 21 into § 1 . In an algebra defined in this way we can introduce 
a binary product by means of the formula 

(35) xy = (x X y)P. 

Then it is easy to see that (33) and (34) hold. Hence it is clear 
that this procedure leads to the same concept as the former 
definition. 

Suppose next that Hi and are arbitrary algebras over the 
same field 中 . Let Pi be the linear mapping of 礼 • X Hi into 21 ^. 
Thus Xiji = (xi X yi)Pi- We now form the Kronecker product 
21 = Hi X 2 I 2 and we consider the Kronecker product 21 X 21 of 
this space with itself. We know that, if x u yi are in 2 li and 
y 2 are in then the mapping 

(36) X x 2 X yi X y 2 —> ^1 X yi X x 2 X y 2 

is an equivalence of 21 X = SIi X Sl 2 X 2li X 2 I 2 onto 3^ X 211 
X 2T 2 X Sl 2 . Also 

(37) X yi X x 2 X y 2 — > S(,vi X ^ 1)^1 X (x 2 X J 2 ) 户 2 
is a linear mapping of 2li X 2li X §l 2 X ^2 into = 2li X 
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Combining (36) and (37) we obtain a linear mapping P of 21 X 21 
into 31. Thus 21 ， together with the mapping P y constitutes an 
algebra over the field 中. If Xxi X x 2 and X y 2 are two ele¬ 
ments of then their product in St is 

(38) (2^i X ^ 2 )(2ji Xy 2 ) = ^^iyi X x 2 y 2 ; 

for, by definition 

(S^x X X 2 X ^1 X y^)P = X y\)P 1 X (*V 2 X y2)P 2 

=^Xiyi X ^2y 2 • 

The algebra H thus defined is called the Kronecker or direct prod¬ 
uct of Hi and - It is an immediate consequence of (38) that，if 
2li and 312 are associative algebras, then the Kronecker product 
21 = SIi X H 2 is associative. 

As an illustration of the concept of the Kronecker product of 
algebras we note the following extension of Theorem 4 . 

Theorem 6. The algebra 8 ( 況 X SK X @) = 2(dt y 9?) X 

8 (®, @). 

Proof. We have already seen that this relation holds in the 
vector space sense. Also we have the relation {A X B){C X D) 
=AC X BD y and this shows that the ordinary product in 
8( 況 X 9? X ©) coincides with the composition defined in the 

Kronecker product of the two algebras. 

A slightly different form of our result is given in the 

Corollary. ^ mn = X $ n . 

EXERCISES 

1. Let a be an element of an algebra 21 and let R a denote the mapping x xa 
determined by a. Show that R a is a linear transformation in 21. Also show that 
the mapping a R a is sl linear transformation of 21 into the space 2 consisting 
of all the linear transformations in 21 . 

2 . Let L a denote the mapping x —> ax. Show that L a is a linear transforma¬ 
tion in H and that a —> L a is linear. 

3. Prove that 21 is associative if and only if L a Rb — RbL a for all a y b. Also 
prove that H is associative if and only if R a Rb = Rab {LJLb = Lba). 

4. Let 21 be the algebra of real quaternions with basis 1 ， i y j y k where 

i 2 = j 2 = k 2 = —1 ， ij = —ji = k y jk = —kj = i y ki = —ik = j. 
Show that 21 X 21 = # 4 . 
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In this chapter we obtain the basic properties of the ring S of 
all the linear transformations in a finite dimensional vector space. 
We determine the ideals, two-sided, left and right, of this ring. 
Also we show that two rings Si and 82 determined respectively 
by the vector spaces and 9i 2 are not isomorphic unless the 
spaces in which they act are isomorphic. In studying the auto¬ 
morphisms of 8 we are led to consider an important type of trans¬ 
formation called semi-linear which generalizes the concept of a 
linear transformation. 

1 . Simplicity of S. As we shall see，there are a number of 
ways of studying the ring 8 of all the linear transformations in a 
vector space SR over a division ring A. The first of these that we 
consider consists in treating 8 as a matrix ring. We introduce a 
set of “matrix units” Eij determined by a particular basis {e\ y e 2y 
• • - y e n ) for 3 i. We define to be the linear mapping such that 

( 1 ) e r Eij = b ir e h r = 1 ， 2 ， •••，《• 

By checking for the base vectors we verify that 

⑺ EijEjcl = dj^Eily 

XEa = 1 . 

Next we introduce a set A of linear transformations which 
correspond to the set of matrices diag {a y a y …， a}. These are 
obtained by associating with each a e A the linear mapping a 
such that 

( 3 ) eidt = ae%. 
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It should be noted that, although a has the same effect on the ei 
as the scalar multiplication ai y these transformations are not in 
general identical; for if x = then ax = while xa 

= = X^i(eia) = Hence a = ai and only if 

a is in the center of A. We remark also that a depends on the 
choice of the basis as well as on a. For the most part we shall 
stick to a single basis; hence the dependence on the basis need 
not be indicated. 

The fundamental correspondence between linear transforma¬ 
tions and matrices associates with a the matrix diag {a y a y • • •， 
a] . Clearly the totality of these matrices is a subring of A n iso¬ 
morphic to A. Hence A is a subring of 2 which is isomorphic to 
A, the correspondence a —> a being an isomorphism. 

It is easy to verify that 

⑷ otEij = Eija 

and that, if eiA — then 

(5) A = 'EaijEij = HEijaij. 

Thus any e 2 can be written as a linear combination with co¬ 
efficients in A of the Eij. Also we have the important formula 

⑹ oiij = 2 EkiAE jk 

k 

for the coefficients in the expression A = 'SdijEij. 

This formula yields a simple proof of the fact that S is a simple 
ring. By this we mean that the only two-sided ideals in 2 are 0 
and 2 itself. Thus let S3 be a two-sided ideal 〆 0 in 2 and let 
B = be an element 5 ^ 0 in S3. Then each = XE ki BEj k 

is in S3. If ^ pq ^ 0, then 1 = H 一 1 is also in and this im¬ 
plies that every e 2 is contained in 93. Hence 33 = S. 

Theorem 1. The ring 2 of linear transformations in a finite 
dimensional vector space is simple. 

EXERCISE 

1. Prove that A is the totality of linear transformations that commute with 
the Eij. 
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2. Operator methods. We shall now give a second proof of 
the simplicity of 2 using operator methods. Let i8 be a two- 
sided ideal ^ 0 in 2. We show first that, if [x] is any one-dimen¬ 
sional subspace of dt y then S3 contains a projection E of dt on [x]. 
Let B 9 ^ 0 belong to S3 and let dtB = [y iy y 2 , • • y r ] where the 
ji are linearly independent. Let be a vector such that x x B 
=yi ， We can find a linear transformation A\ such that y\A\ 
=Xi andyi^i = 0 for / > 1. Then x^BAx = y\A x = Hence 
Ei = BAi is a projection of dt on [xx]. Now let C and D be linear 
transformations such that xC = Xi and XiD = x. Then if £ = 
CE\D^ dtE = dtCEiD = [a ； i]D = [x] and xE = xCEiD = X\R\D 
= X\D = x. Hence jE is a projection of 3t on [x]. Since E = 
CE x D y E 

Now let £ be a projection of maximum rank in S3. We assert 
that E = l. Otherwise © = dtE cz and there is a vector 
z 〆 0 such that zE = 0. As we have seen, S3 contains a projec¬ 
tion F of dt on [z]. Now set G = E + F — EF. If a; e 

xG = xE + xF — xEF = x xF — xF = x. 

Moreover, 

zG = zE + zF — zEF = zF = z. 

Thus G acts as the identity in © + [z]. Then dtG 3 dtE + dtF 
=@ + [z]- It follows that G is a projection of greater rank than 
E. Since G e S3，this contradicts the choice of E. Hence we see 
that E = 1 e S3. Clearly this means that 33 = 2. 

We use a similar method to prove the following 

Theorem 2. If ? is the ring of linear transformations in 0? 
over A y then reciprocally A is the complete set of endomorphisms in 
dt which commute with all the transformations contained in 2. 

Proof. Let C be an endomorphism in 況 which commutes with 
every element of g. If x is any vector in % then ^ and xC are 
linearly dependent. Otherwise there exists an J e ? such that 
xA = 0, but {xC)A 0. This contradicts 0 = {xA)C = xCA. 
Thus for each x 9 ^ 0 y xC = Now let x and y be any two 

non-zero vectors. Then 

xC = y x x y yC = y v y. 
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On the other hand，there exists a 5 e 8 such that xB = y. Hence 

yC = xBC = xCB = y x (xB) = y x y» 

Hence y x = y y . This proves that xC = yx for all 〆 0 . Since 
this holds also for at = 0 ， C is the scalar multiplication 7 卜 

3. The left ideals of S. In order to determine the one-sided 
ideals of S we shall make use of still another technique, namely, 
we consider 8 as a product group. Let dt f be a right vector space 
dual to 沉 relative to the bilinear form g(x 3 x f ). As in the preced¬ 
ing chapter we define x f X y for x f e and jy e 9 ? to be the map¬ 
ping x —> g(x y x’)y. Then we know that S is a direct product 
況/ X 9? relative to this multiplication. 

We consider now the representation of the product (resultant) 
of the two mappings X y and u f X v. We have the following 
equations: 

4(〆 X y){u f X v)] = g(x y x f )y{u r X v) = g{g{x y x f )y, u f )v 

= 畧0, ^)g(jy 

^ = 文 0, ^g(yy u f ))v 

which show that 

(x f X y) {u r X v) = x f g{y y u f ) X v = x f X g{y y u f )v. 

More generally，if we use the distributive laws, we see that 
⑺ (Zx/ X yi)(Eu/ X vj) = u/) X vj 

= 2 ^/ x g(jiy u/)vj. 

This fundamental multiplication rule shows us how to con¬ 
struct one-sided ideals in 8 = X 9?. Let @ be any subspace 
in 9? and set 3’ = 沉 ’ X © the totality of linear transformations 
of the form Xu/ X Vj where 以 / e 況’ and vj e Clearly is 
closed under addition and subtraction. Moreover, by (7), ^ is 
closed under left multiplication by arbitrary elements of Thus 
is a left ideal. In a similar fashion we see that，if ©’ is a sub¬ 
space of 9?^ then 3 = ©’ X 9? the totality of mappings Xx/ Xyi 
where x/ e and yi e 3? is a right ideal in 8 . 

The main result we shall establish is that the ideals X 
X 況 are the only one-sided ideals in S. We consider left ideals 
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first. Let 3’ be any left ideal _ 0 in 8 and let @ be the join of 
all the rank subspaces diB for B in If 5 # 0, we can write 

r 

—- Z>/ x Vj where r is the rank of B. Then it is easily seen 

l 

that the set (t ； i, v 2y •••，〜）is a basis for and (“i’ ， u 2 f y • • 
u/) is one for B f the transpose of B (cf. Chapter V， § 5). 

Since the vj e C ©, 5 e X ©. Hence 3' S 況 ’ X Next 

let yi y y 2y • • •，be vectors such that g{y% y u/) = 5^- and let Xi y 
x 2 \ •••，％/ be arbitrary in Set A = Xx/ X yi- Then by ⑺ 

(8) AB = ^x/g(y iy u/) X vj = Xx/ X 

and this linear transformation is in 3’- This shows that, \i v — 
X^iVi is any vector in diB and 〆 is arbitrary in 況 ’， then the map¬ 
ping x f X v = X Vi e It follows also that, if B u B 2y 

… are any linear transformations in 3’ and v^ k) is any vector in 
dlBky then X v (k) is in Thus 況 ’ X © £ 3’ and this proves 
the following 

Theorem 3. Every left ideal in 2 has the form 況 ’ X © where 
© is a subspace of 9i. The subspace @ is in fact the join of all the 
rank spaces dtB y B in 

This result can also be formulated in another way. Let © be 
any subspace of 5R. Define 3’(©) to be the totality of B such 
that dtB C Clearly 3’(©) is a left ideal in 2 - On the other 
hand, let ^ be any left ideal in ? and, as before, let © be the join 
of all the subspaces dtB y B in Obviously ^ Q 3’(©)，and 
Theorem 3 shows that 3’ = 況 ’ X ©• Now let B e 3’(©). Then 
dtB Q © and，if dtB — [vi y v 2y •••，〜] where the Vi are linearly in¬ 
dependent, B = X Vj. Hence the Vi e © and -S e Si 7 X © = 
Thus 3’ = 3’(©). We therefore have the following alter¬ 
nate form of Theorem 3. 

Theorem 4. Every left ideal in 8 has the form the 

totality of linear transformations which map 9? into a subspace ©. 
The space © is the join of the rank spaces oj the mappings belonging 
to^. 

Theorem 3 (or 4) establishes a 1-1 correspondence @ > 況 ’ X 

© (3’(©)) between the set of subspaces of 9? and the set of left 
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ideals of 2. Clearly this correspondence preserves order: if ©x ^ 
© 2 ，then 況 ’ X ©i 2 況 ’ X © 2 . It follows that we have a lattice 
isomorphism of the lattice of subspaces of 況 onto the lattice of 
left ideals of 2. 

EXERCISES 

1. A left (right, two-sided) ideal 3’ is called minimal if 3' # 0 and there exists 
no left (right, two-sided) ideal 3" such that 3’ ] 3" 〕 0. Show that 2 pos¬ 
sesses minimal left ideals and find their form. 

2. A left (right, two-sided) ideal ^ is called maximal if 3' 〆 2 and there exists 
no left (right, two-sided) ideal 3" such that C 3" C S. Show that ? pos¬ 
sesses maximal left ideals and find their form. 

3. Prove that, if is a left ideal in the matrix ring △„，△ a division ring, then 

there exists a matrix (ju) in Z(A, n) such that 一 1 is the set of matrices of 

the form 


'^11 

«12 

… Oilr 

0 

… 0 ， 

«21 

• 

OL22 

• 

… «2r 

» » « • 

0 

• 

… 0 

• • • • 


OL n 2 

… Oi nr 

0 

•. • 0- 


aij arbitrary. 

4. Prove that every left ideal of S is a principal ideal 2E generated by an 
idempotent element E. 

4. Right ideals. If* 3 is a right ideal in the set 3 ’ of transposes 
B\ 5 e 3 , is a left ideal in the ring of linear transformations 
in the dual space 況 ’. Moreover, Q is the set of transposes of the 
mappings in We can therefore deduce the form of 3 from 
that of 3' If we apply Theorem 3 to we see that = & 
X’ 況 ， the totality of mappings Xx/ X f yi where x/ e & and ji 
e and where 'Ex/ X ,denotes the mapping 

(9) 〆 2x/g(y iy x ; ). 

Hence 3 is the totality of mappings 

(10) «v — 2g(x y x/)yi 

in 2. Thus 3 = X 9?. We therefore have the following 

Theorem 5. Every right ideal ^ in 2 has the form ©’ X 9? where 
& is a subspace of 9 ?’. 

We can obtain a correspondence also between subspaces of 9 J 
and right ideals of 2. For this purpose we consider the subspace 
@ = j{&) of vectors y m dt such that g(y y y r ) = 0 for all y r in 
If j 8 @ and jB e 3 , then, by (10), yB = 0. Also if z is any 




_THE RING OF LINEAR TRANSFORMATIONS_ 233 

vector such that zB = 0 for all B in 3, then 2 兄 ( 2 , x/)yi = 0 for 
all x/ e © and all yi e 0?. If the are chosen to be linearly inde¬ 
pendent, then this implies that g{z y x/) = 0. Thus z e Hence 
@ can be characterized as the totality of vectors annihilated by 
every 5 in 3, Suppose next that C is any linear transformation 
such that yC = 0 for all jy e 0. We write C = 'Zx/ X y% where 
the yi are linearly independent. Then 0.= yC = Xi)y^ 

and so g(y y x/) = 0 for all jy e ©. Hence the 87 (©) = )(i (©’)） 
= ©’ and C 8 3 . We therefore see also that 3 is the totality, 
denoted as3(©)> of linear transformations which annihilate every 
vector in This proves 

Theorem 6. Every right ideal y Q in 2 has the form 3(©)^ the 
set of linear transformations which annihilate a subspace ©. The 
subspace © is the totality of vectors annihilated by every B e 

Since is arbitrary in 9 ?^ @ is arbitrary in 9 f. If @ is any sub¬ 
space of 5 R, it is clear at the start that the totality 3 = 3 (©) of 
linear transformations which annihilate © is a right ideal in 
The above argument shows that the only vectors annihilated by 
every mapping in3(©) are those in ©• Moreover, we have proved 
that every right ideal has the form 3(©). Thus the correspond¬ 
ence © —> 3 (®) is 1—1 between the set of subspaces of 況 and the 
set of right ideals in 2 . Clearly this correspondence reverses 
order: if* @1 2 © 2 , then ^(©i) £ < 3 (© 2 ). 

EXERCISES 

1. State and prove the analogues of Exs. 1, 2, 3, 4 of p. 232 for right ideals. 

2 . Prove that, if ^ is a left ideal 9 ^ 0, then the only vector which is annihi¬ 
lated by all the linear transformations in is 2 == 

3. Use Theorem 6 and Ex. 2 to prove that 8 is simple. 

5. Isomorphisms of rings of linear transformations. Let 3 be 

a right ideal # 0 in S. Then there exists a vector x such that x^ y 
the set of images xB y B in 3 , is not 0 . If B x and B 2 are in 3 , 
then 

(11) x(Bi + B 2 ) = xBi + xB 2 . 

Hence the mapping B —> is a homomorphism of the additive 
group of 3 into It follows that the image under this homo- 
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morphism is a subgroup of the group 9 i. We shall now show that 
is in fact the whole of 5 R. We note first that xQ is mapped 
into itself by every A for if y e y — xB for some B 
and yA = xBA = xB f where B f = BA is in 3 . Hence yA e 
We note next that is closed under scalar multiplication. If 
a & A there exists an / in S such that yA = ay. Then ay — yA 
is in Thus we see that is a non-zero subspace invariant 
under S. We have seen (Chapter IV, p. 116) that the only such 
subspace is dt itself. Hence we have the following 

Lemma 1 . If ^ is a right ideal 9 ^ 0 and x is a vector such that 
•^ 3 〆 0 , then xQ = 9?. 

We observe next that the mapping B xB is more than a 
group homomorphism, namely, it is an operator or module ho¬ 
momorphism. This means simply that 

(12) BA -> 

which is clear since {xB)A = x{BA). Thus if we denote our 
mapping as Xy then ( 12 ) reads 

(13) _ x = (B x )J y 

an equation which holds for all 5 in 3 and all A in S. 

Equation (13) shows that the kernel of the homomorphism % 
is not merely a subgroup of the additive group of 3 but a right 
ideal of the ring S; for if Bx = 0 , then {BA)x — {B^)A = 0A 
= 0 . It follows that，if 3 is a minimal right ideal, then the ker¬ 
nel of x is 0 . This，of course，means that x is an isomorphism. 

Lemma 2. If ^ is a minimal right ideal and ^ 0, then the 
homomorphism 乂 •• B — xB is an isomorphism of Q onto ^ 

If X * -1 denotes the inverse mapping of 9 ? onto 3 and A r denotes 
the right multiplication B BA in then，by (13 )， A r x = 
so that 

(130 A r = - 1 • 

This relation between the vector space and any minimal right 
ideal of 8 gives the underlying reason for some remarkable re- 
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suits on rings of linear transformations which we shall now de¬ 
rive. The first of these is the following 

Theorem 7. Let dti y i = 1, 2, be a vector space over a division 
ring A{ y and let be the ring of linear transformations in over 
A*. Then if is isomorphic to S 2 > is isomorphic to A 2 and the 
two spaces have the same dimensionality. 

Proof. Let 0 be an isomorphism of 2i onto S 2 and let 3i be a 
minimal right ideal in 2i. Then the image Q 2 = is a mini¬ 
mal right ideal in ? 2 . Let Xi be an isomorphism of onto 9?^ de¬ 
fined as above. Thus 

( 14 ) Air = Xl^lXl^y A 2 t = X2 為 X2 一 1 

if AiZ S%. Also if B\ e 3i. Hence Ai r <t) 

= (j>{Ai4)) r where, as throughout this proof, A x <i> denotes the 
image of A\ under 0. Thus 

(15) (^10) r = 

Combining (14) and (15) we obtain 

為 0 = X2 _1 (^10)rX2 = X2 一 1 d<l>X2 
= (X2—V—Wi(xi—Vx2). 

Since xi -1 is an isomorphism of 況 ， onto <f> an isomorphism of 
3i onto 3 2 and X 2 an isomorphism of 3 2 onto 沉 2 ，the mapping 
U = xi~~ 1( t>X2 is an isomorphism of dti onto 9? 2 . Moreover, we 
have proved that 

(16) = U~ l A x U. 

Now let an denote a scalar multiplication on SRx. Since an com¬ 
mutes with every A\ e 8i, U^ l auU commutes with every 
hence with every A 2 e S 2 . By Theorem 2 this implies that 
U~ l auU is a scalar multiplication in 沉 2 . Similarly if a 2 i is any 
scalar multiplication in 況 2 , then an = Ua 2 iU~~ l is a scalar mul¬ 
tiplication in 5Ri. Clearly U^auU = a 2 i. Hence the mapping 
an —> U~ l auU is an isomorphism of the ring An of scalar mul¬ 
tiplications in onto the ring A 2 i of scalar multiplications in 沉 2 . 
Now let ai u denote the element in A 2 such that 

{oli u )i = U~ l auU. 
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Then the mapping u thus determined is an isomorphism of Ai 
onto A 2 . For any Xi in dti and any in A iy we have 

C/ = 卜帅 ) C7= (x^iU^auU) 

= {XlU) {OLl U )ly 

or 

(17) {oLiX\)U = Oii^XiU). 

This equation shows that 9?i and 9? 2 have the same dimension¬ 
ality. Let (eiy e 2y • • 、 ^ n ) be a basis for 9fi over A. Then any 
x = in Ax. Hence by (17) xU = 而 ) [/ = X^i u (eiU) 

so that the vectors eiU are generators of 況 2 . Moreover, if we 
have a relation between the eiU, then we can write it in the form 
= 0. Then (2 匕 a) [7 = 0 and the ^ and ^i u are all 0. 
This completes the proof. 

In reality we have proved a good deal more than we set out 
to prove. In order to state the precise result we shall make use 
of an important generalization of the concept of a linear trans¬ 
formation which we define as follows: A mapping U of a vector 
space 況 i over into a vector space 5R 2 over A 2 is called a semi- 
linear transformation if 1) is a homomorphism of the additive 
groups and 2) there exists an isomorphism a of 〜onto A 2 such 
that 

(ax) U = a u (x U) 

for all ^ e and all a e Ai. If u f is a second isomorphism such 
that the above equation holds, then (a u — a u ， ){xU) = 0 for all 
x. Hence，if ^ 0, = a u， and u — u r . Thus if 〆0， a is 

uniquely determined by U and in this case u will be called the 
associated isomorphism of U. 

Let f/i be a semi-linear transformation of 9ti into 況 2 and U 2 
a semi-linear transformation of 9? 2 into a third vector space 9f 3 . 
Let U\ and u 2 be the isomorphisms of U\ and U 2 respectively. 
Then 

= a^xUM. 

Hence UiU 2 is a semi-linear transformation of 9?i into 9? 3 with 
associated isomorphism UxU 2 . Suppose next that Ui is 1-1 of 
onto 9? 2 and let U\~ l denote the inverse. Then from (ax)U i 
= a ul (xUi) we obtain ax = (a^ixUi^U^ 1 . Replacing xUi by 
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a ui by a y this becomes (ax)U 1 ~ 1 = a ui \xUi~ 1 ). Hence U x ~ l 
is semi-linear with isomorphism Ui~ l . 

These remarks show that, if A x e8i and C/ is a 1-1 semi-linear 
transformation of 況 i onto 況 2 ， then U~ X A X U e ? 2 . It is clear 
that Ax — > U~ x ^iU is an isomorphism of onto S 2 . This is，of 
course，rather trivial, but it is striking that the converse holds 
and this is what equations (16) and (17) show. 

Theorem 8. Any isomorphism A x —> Ai<j> of 2i onto 2 2 is given 
by a 1-1 semi-linear transformation U of "tfti onto 9? 2 in the sense 
that A\(j> = U~ l AiU, 

This, of course，gives the following 

Corollary. Any automorphism of 2 is given by a 1-1 semi-linear 
transformation of dt onto itself. 

EXERCISES 

1 . Let (ei, <? 2 , * • *, ^n) be a basis for 9? and let C/be a semi-linear transformation 
of 9t into itself. If dU = Hanej y then (a) is the matrix of U (relative to the given 
basis). Show that U is completely determined by (a) and the associated auto¬ 
morphism. Find the transformation formula giving the matrix of U relative to 
a second basis. Show that to any pair ((a), «), (a) a matrix and u an automorph¬ 
ism, there corresponds a semi-linear transformation whose matrix relative to 
(<?i, e 2 y … ， e n ) is (a) and whose automorphism is u. 

2. If U is semi-linear with matrix (a) and automorphism u, we write 
U — ((a), u). Show that, if U ((a), u) and V ( ⑹， v )，then 
UV -> ((a) v (j8), uv), (a) v = «). 

3. Prove that the image 0t/of a subspace under a semi-linear transformation 
C7 is a subspace. Prove that the set 3 of vectors mapped into 0 by C7 is a sub¬ 
space. Prove the dimensionality relation dim 9?£7 + dim S = n - 

4. Show that the scalar multiplications are semi-linear transformations. 

5. Let 2 be the ring of linear transformations in a vector space over a field 中 . 
Prove that every automorphism of 2 which leaves the elements of the center 
fixed is inner, that is, has the form A —> U~ l AU where Ue2. 
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INFINITE DIMENSIONAL VECTOR SPACES 


Up to this point we have directed our attention to the considera¬ 
tion of finite dimensional vector spaces exclusively. While it is 
true that the basic concepts of the finite case are applicable foi 
arbitrary spaces, it is not obvious that all of these are significant 
for spaces without finite bases. 

In this chapter we give an introduction to the study of arbi¬ 
trary vector spaces. The study of such spaces constitutes a com¬ 
paratively new field of research whose development has been in¬ 
fluenced to a considerable degree by demands of analysis. The 
most important applications make use of topological notions as 
well as of algebraic notions. The point of departure for these 
applications is the concept of a topological vector space. On the 
other hand, a number of interesting results have been found 
which deal with arbitrary (discrete) vector spaces and it is these 
which we shall discuss here. Notions from topology do not ap¬ 
pear at the beginning of our discussion, but we shall encounter 
these in the consideration of certain natural topologies for sets of 
linear transformations. These will serve to give simple descrip¬ 
tions of purely algebraic results. 

Many of the results which we shall give are direct generaliza¬ 
tions of results in the finite case. However，there are some essen¬ 
tial differences. The most important of these is the fact that the 
conjugate space of the conjugate space of a vector space cannot 
be identified with the original space. In fact, if 9? is infinite di¬ 
mensional, then dim > dim 3?， and this precludes the equa¬ 
tion = 9?. 
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In the last part of this chapter we shall take up again the study 
of sets of linear transformations. As we shall see, a fundamental 
lemma of Schur permits the reduction of the theory of irreducible 
sets of endomorphisms to that of irreducible sets of linear trans¬ 
formations. In addition to this lemma we shall prove a density 
theorem for irreducible sets of linear transformations which gen¬ 
eralizes a classical theorem of Burnside. 

Naturally, the present considerations will require more power¬ 
ful logical tools than those which served in the finite case. Among 
these we mention particularly Zorn’s lemma and the theory of 
cardinal numbers. We shall assume a familiarity with these no¬ 
tions as well as with the elements of topology. 

1. Existence of a basis. Let 況 be an arbitrary vector space 
over a division ring A. We recall that a subset 6* of* 況 is a set of 
generators of 9? if every vector in 9? is a (finite) linear combina¬ 
tion of the vectors belonging to S. The set S is linearly independent 
if every finite subset jF of ^ is linearly independent. A subset B 
which is linearly independent and a set of generators is a basis 
in the sense that every vector can be written in one and only 
one way as a linear combination of elements in B. 

We shall now prove the following two basic results: 1) any set 
of generators contains a basis for 況 and 2) any linearly inde¬ 
pendent set of elements can be supplemented by elements from 
any basis to give a basis. For both of these results we shall use 
Zorn’s lemma in the following form: 

Let P be a partially ordered set which has the property that every 
linearly ordered subset has an upper bound. Then P possesses a 
maximal element ， 

The concept of a partially ordered set has been defined in 
Chapter I. We recall that this is a set in which a binary relation 
a < i is defined such that: (i) a < a 9 (ii) if a < i? and b < 
then a = b\ and (iii) \i a < b and b < then a < c. A linearly 
ordered set (or a chain) is a partially ordered set with the property 
that any two elements are comparable in the sense that either 

* This maximum principle seems to have been discovered first by Hausdorff. Its im¬ 
portance in algebra was first recognized by Zorn. An adequate discussion of the principle 
can be found in Birkhoff’s Lattice Theory y 2nd edition, p. 42. 
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a < b or b < a. An upper bound of a subset 6* of a partially 
ordered set is an element u e P such that s < u for every s in S. 
An element m of a subset S is maximal \( no s 9 ^ m \n S has the 
property m < s. 

We give now the proof of statement 1) above. Let ^ be a set 
of generators for 9?. Let P be the collection of linearly independ¬ 
ent subsets of S. Then P is a partially ordered set relative to the 
relation of inclusion. Let L be a linearly ordered subcollection 
of P y and let U be the logical sum of the sets belonging to L. 
We assert that U is linearly independent. Otherwise U contains 
a dependent set u u u 2 ) • • • ， u m . Now Ui e e L. Also for any 

j either Ai Q Aj or yfy C Ai. Hence one of the say A m , 

contains all the others. Thus every Ui e A m and A m contains a 
finite linearly dependent subset. This contradicts the assump¬ 
tion that A m e P; hence U e P. It is clear that this element 

serves as an upper bound for all the A zL. We can now apply 
Zorn’s lemma to conclude that P contains a maximal element ， 
and this means that the set of generators S contains a maximal 
linearly independent subset B. It is now easy to see that 5 is a 
basis for 9?. If j is any member of ^ not contained in B y then the 
set B (J y is a dependent set. This implies that jy is a linear 
combination of elements of B (Lemma 1 on p. 11). Hence every 
s eS is a linear combination of elements of B. It follows that B 
is a set of generators and, since 5 is a linearly independent set, 
B is, in fact，a basis for 3?. 

The proof of 2) is similar to the foregoing. Here let 6* be a 
linearly independent set and let 5 be a basis. Let P be the col¬ 
lection of linearly independent sets containing S and contained 
in U 5. Then a repetition of the above argument shows that 
P contains a maximal element C. It follows easily that C is a 
basis for 況 . 

2. Invariance of dimensionality. We wish to prove next that 
the cardinal numbers of any two bases for 況 are equal. 

Let B and C be two bases for 9?. We label the elements of B 
by subscripts i belonging to a set / and the elements of C by 
subscripts 々 in a set K. If, say, B (or I) is finite, then 9J has a 
finite basis. Then we know that C is also finite, and its cardinal 
number is the same as that of B (Theorems 2 and 3, Chapter I). 
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It therefore suffices to consider the case in which both B and C 
are infinite. Here the following argument due to Lowig can be 
applied. Express each ei of B in terms of the fk of C as, say, 

= Plfk! + 々 2 九 + … + 

where the 〆 0. Now every/* occurs in some such expression; 
for if a particular/ a ； does not occur, then，since this fk is a linear 
combination of the e J s and each e is a, linear combination of f y s 
〆 fkyfk is a linear combination of/’s 〆/&• This contradicts the 
linear independence of the/’s. 

We can now define a single-valued mapping 0 of the set C into 
the set B. Let /a ； e C and let ei = be one of the in B 

whose expression involves We thus obtain a single-valued 
mapping of the whole of C into B. Let B f = /(C) be the image 
set. If ei» 8 the inverse image consists of fk which 

occur in the expression for e^. Thus </> -1 (^0 is a finite set. Now 
we have a 1—1 correspondence between the set B f and the col¬ 
lection r of inverse images 洽一 1 (〜•'）• The collection r gives a de¬ 
composition of the set C into non-overlapping finite sets. More¬ 
over, since C is infinite, r is infinite. It follows easily from stand¬ 
ard theorems in the theory of cardinal numbers that C and r 
have the same cardinal number.* Hence the cardinal number of 
B r is the same as that of C and so the cardinal number of B is 
greater than or equal to that of C. If we reverse the roles of B 
and C, we see that the cardinal number of B does not exceed that 
of C. Hence by Bernstein’s theorem these two sets have the 
same cardinal number. 

As in the finite case we shall call the cardinal number of any 
basis the dimensionality of over A. Also as in the finite case 
we can construct a vector space over any given A with dimen¬ 
sionality any given cardinal number. For this purpose let I be 
a set having the given cardinal number. Let dt be the set of 
functions defined on / with values x(i) in A such that x(i) = 0 
for all but a finite number of i e /. We define the sum of two such 
functions by addition of coordinates and scalar product by 
left multiplication of the coordinates by the given element of A. 


Consult for example, Sierpinski, Leg on s sur les Nombres Transjinis, Paris, 1928, 
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These compositions yield results in 9?， and it is clear that the 
postulates for a vector space are fulfilled. We now determine a 
special basis for 9?. For each i e I y we define ^ to be the vector 
such that 

⑴ ^i(j) = hij. 

It is easy to see that these vectors are linearly independent. If 
•v is any vector，let i 2y • • •, i m be the i for which x{i) 0. 

Then if x(ij) == it is clear that ^ + ^ 2 e i2 H - h 

Hence the ei form a basis. Since / — g is a 1-1 correspondence, 
this basis has the same cardinal number as /. 

We remark also that, as in the finite case, any two vector spaces 
which have the same dimensionality are equivalent. In particu¬ 
lar, any vector space is equivalent to a space of functions of the 
type just constructed. 

3. Subspaces. Almost all the properties, noted in Chapter I ， 
of the lattice of subspaces of a finite dimensional vector space 
hold also in the infinite case. Exception must be made for the 
chain conditions. In fact, it is clear that neither of these condi¬ 
tions holds for vector spaces with infinite bases. 

Our former considerations made use of bases only in the proof 
of the existence of a complement of a subspace. Property 2) can 
now be used to carry over the argument used to prove this result. 
Let © be a subspace of 況 . Then we know that @ has a basis S. 
Since ^ is a linearly independent set，it can be imbedded in a 
basis B of 9?. We write B = S U T where 6* fl T 1 is vacuous, and 
we let & be the space spanned by the vectors in T. It is immedi¬ 
ate that 9? = @ + ©/ and that @ fl ©’ = 0. Hence is a 
complement of 

The argument which we have used here can also be used to 
prove the existence of a special type of basis for any subspace of 
況 . The result is the following 

Theorem 1. Let 9? have a basis B = {ei ). Then if 0 is any 
subspace of dt y we can divide B into two non-overlapping subsets 
C = (ej)y D = (ek) such that © has a basts of the form /y = + Uj 
where the Uj are in the space spanned by D and fj —> ej is a 1-1 
mapping onto C. 
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Proof. There exists a complement & of © spanned by a sub¬ 
set D = (ek) of B. Let C = (e/) be the complement of D in B. 
Then each ej = fj — Uj where fj e © and Uj e ©’ and，as we pro¬ 
ceed to show, (fj) is a basis for ©• The set (fj) is linearly inde¬ 
pendent, for let 2^/y = 0. Then + 2 卢外 • = 0; hence every 
I3j = 0 by the linear independence of the ej. The set (fj) gen¬ 
erates ©; for if j e ©，then y = + 'Sjkek = — 

+ 27^. Then y — 2/^/；. e @’，and hence y — = 0. We 

note finally that, if ej and dy are distinct elements in C y then 
/i 〆 /y'. Otherwise ej — ej^ e @’，contrary to the fact that B is 
a basis. We therefore see that the mapping ej —> fj is 1-1 and 
this concludes the proof. 

Theorem 1 is due to Emmy Noether. It is therefore appropri¬ 
ate to call a basis of the type described a Noether basis for the 
subspace © relative to the basis B of 9?. 

4. Linear transformations and matrices. The connection be¬ 
tween linear transformations of finite dimensional vector spaces 
and finite matrices can be carried over directly to the infinite 
case. 

Let 況 and © be vector spaces over A and let B = (ei) be a 
basis for SR. Then we note first that any mapping ei yi of B 
into @ can be extended in one and only one way to a linear trans¬ 
formation of 9? into ©• As is easily verified, this extension maps 

m m 

2 h e ii into D Next let C = : (A) be a basis for @ and 

i i 

write the image of ^ relative to the linear transformation A as 
⑵ eiA = yi = ^a ik f k 

where the sum is finite. Thus the matrix (a^) is row finite in the 
sense that for a fixed i a ik ^ 0 for only a finite number of k. 
In general, if I and J are any two sets, then a function on the 
product set / X / into A is called an / X / matrix over A. Thus 
we have established a correspondence between linear transforma¬ 
tions of 9J into © and row finite / X / matrices over A. Of course, 
this correspondence depends on the choice of basis. In the special 
case 91 = © it is natural to take C to be the same as the basis B. 

* This establishes the existence of non-trivial linear transformations of into ©• It 
seems to be impossible to do this without using bases. 
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We then obtain an / X / “square” matrix as the matrix of A 
relative to the basis B. 

We can verify easily as in the finite case that the correspondence 
A —> (a) determined by (2) is 1-1 of the set 8 ( 況 ， ©) of linear 
transformations onto the set of row finite / X / matrices. The 
matrix corresponding to the sum of two transformations is ob¬ 
tained from the two matrices by adding components aa^ It 
follows that the row finite matrices form a group relative to this 
operation. 

If S = S ( 況，況 ） and the matrix of A is determined by a single 
basis, then it can be seen that the element 7 a of the matrix AB is 

⑶ 7i\ = 2 oi ik 0k\ 

k 

where A (a) and B —> ⑹ in our correspondence. The sum 
in (3) is finite, and the product matrix ( 7 ) = (a) ((3) is row finite. 
It follows now that the set A/ of / X / row finite matrices to¬ 
gether with the indicated addition and multiplication is a ring 
isomorphic to the ring 

Changes of bases can also be discussed as in the finite case. 
If we have a second basis for we can suppose that it has been 
put into 1-1 correspondence with the same set of indices I. If 
we denote the vectors in this basis by 九 then we can write 

⑷ f k = ei = ^Vikfk 

where (jjl) and {v) are row finite / X / matrices. It follows easily 
that (m)(") = 1 = {v) (m) where 1 is the matrix with elements ba. 
Thus (fx) is a unit in A/ in the sense that is has a two-sided in¬ 
verse {v) = (ju) -1 . Conversely if (/x) is any unit, then the fk de¬ 
fined. by the first set of equations in (4) is a basis for 

If is a linear transformation with matrix (a) relative to the 
basis (ei) y then one verifies directly that the matrix of A relative 
to (/i) is (m) (a) (m) _1 . 

5. Dimensionality of the conjugate space. If 況 is a finite di¬ 
mensional vector space, then we know that the right vector 
space 9 ?* of linear functions on dt has the same dimensionality 
as 9 ?. A fundamental difference between the finite and the infi¬ 
nite theories is that this does not hold for 9? infinite dimensional. 
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In this case we shall show that dim 5 R* > dim 5 R. More precisely 
we shall show that if the cardinal number of △ is J and the di¬ 
mensionality of 9 ? is 彡， then the dimensionality of is d b ，the 
cardinal number of the set of mappings of a set of cardinal num¬ 
ber b into one of cardinal number d. We prove first the following 

Lemma 1. If dim i is infinite and the cardinal number of 
A is d y then the cardinal number of 9? is bd. 

Proof. If {e t ) is a basis for 9 ?， every non-zero vector a; in 9 ? 
has a unique representation as 

N 

= > : 〆 0. 

J=1 

Thus with each x # 0 we can associate a uniquely determined 
subset e iiy e i2y • • •, e iN and a unique iV-tuple (^ l5 ^ • • • ， ^ iN ) with 
non-zero components in Since (ei) is infinite，the cardinal 
number of the set of subsets containing iV elements of (ei) equals 
b ，On the other hand, the cardinal number of the set of N- 
tuples U 2 , .. •，^ iN ) is either d N ) or it is finite. In either 
case the cardinal number of the set of pairs consisting of the set 
e h , e i2y • • 、 e iN and the iV-tuple (匕 ，& 2 , • • •， is 办 . It follows 
that the cardinal number of 5 R is db 七 db 七 • • • •、hence it is 
simply db. 

Any linear function on 況 is determined by its values on the 
basis (ei) of 9 ? and there exists a linear function such that f(ei) 
is any element of A. Thus we have a 1-1 correspondence be¬ 
tween SR* and the set of mappings of into A. It follows that 
the cardinal number of 5 R* is d h . On the other hand, if — 
dim 9 t*，then Lemma 1 shows that the cardinal number of 9 ?* 
is db\ Hence db^ — d h . Since db^ is the maximum of d and h\ 
the relation — d h will follow if we can show that > d. 
Since it is clear that is infinite, the relation > d holds if 
d < aleph null. Hence we shall assume from now on that d > 
aleph null. In order to establish the required inequality in this 
case, we consider collections of denumerable sequences ( 71 , 72 > 
… ）with in A. A collection F of such sequences will be called 

* This follows from the well-known result that b N = b. See Sierpinski, Lemons sur les 
Nombres Transfirtis^ p. 217. 
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strongly independent if every finite square matrix chosen from the 
collection is non-singular. We choose a finite square matrix from 
F by selecting first a finite set of sequences 

(7l (1) ， ？ 2 (1) ， •••) ， (7i ( 2) , 72 (2) , •••)，•••，Ovi ⑷， 72 (n) , - - •) 
and then a set i\ y i 2y …， i n of indices，obtaining the matrix 

a) a) ... (i) 

1J 12 / tn 


V. ( n ) /y- (n) • . • 〜 .（ n ) 

/*1 /tn 

We now prove the following 

Lemma 2. There exists a strongly independent collection of se¬ 
quences with cardinal number > d.^ 

Proof. We partially order the strongly independent collections 
F by inclusion. If a set {F} of these collections is linearly ordered, 
clearly U i 7 is strongly independent. By Zorn’s lemma, there 
exists a maximal strongly independent collection M. We shall 
prove, by induction, that if the cardinal number of M is less than 
d, then we can construct a sequence X 味 M such that MU {X} 
is strongly independent, thereby contradicting the maximality of 
M. Suppose that we have found the first p elements 芒 2 ， • • •， 

of X so that every q X q matrix, q < p, chosen from MU 
专 2 ， •••，^ P ) is non-singular. We shall determine so that 

every r X r matrix, r < p + 1, chosen from MU (L，• • • ， ^ p +i) 
is non-singular. The conditions that this imposes on 专 P+1 are 
that every matrix of the form 

氺 

A : 

參 

* 

^12 • • • 5»r-l ^P+l 

* This lemma was communicated to the author by I. Kaplansky. It was proved by 
Kaplansky in collaboration with P. Erdos. 
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where the ^/isanr—lXr— 1 matrix determined by M，be 
non-singular. Now for each matrix of the form (5)，in which 
^ p+1 is regarded as an indeterminate, there is just one choice of 
in A making (5) singular. Thus，J is a non-singular matrix; 
hence its row vectors are left linearly independent. It follows 
that the row vector ( 匕 ” ^ • • •，U can be written in one and 
only one way as a linear combination of the rows of A. Then if 
fx represents the same linear combination of the elements of the 
last column of (5) ， (5) is non-singular, provided that 匕 +i 〆 从 . 
We note next that the cardinal number of the collection of ma¬ 
trices (5) in which 匕 +i is an indeterminate is less than d. By our 
assumption the cardinal number of M is less than d. The cardi¬ 
nal number of the set of matrices under consideration is the prod¬ 
uct of the cardinal number of sets of r — 1 sequences chosen 
from M times the cardinal number of r — 1 elements chosen in 
the integers 1 ， 2 ， … ， p. The result is either finite or the cardi¬ 
nal number of M. In either case it is less than d. Since the 
cardinal number of A is d y we can choose a ^ p+1 so that all the 
matrices (5) are non-singular. This completes the proof by in¬ 
duction of the existence of X such that MU {X} is strongly in¬ 
dependent. We have therefore contradicted the maximality of 
M and established the lemma. 

We can now prove the main result. 

Theorem 2. If ^ is a vector space of infinite dimensionality b 
and the cardinal number oj the division ring A is then the dimen¬ 
sionality of 5K* is d h . 

Proof. We have seen that it suffices to prove that and 

we may assume that d exceeds aleph null. Let ⑹ be a basis for 
9 ? and select a denumerable set ⑺） in ⑹. Let M be a strongly 
independent collection of denumerable sequences. For each ( 7 ^ 
72 ， • • •) 8 M’ we can define a linear function /such that f(ej) = yj. 
The collection of linear functions thus obtained from the ele¬ 
ments of M is a linearly independent one. Its cardinal number 
is the same as that of M. Hence by Lemma 2 we may suppose 
that it is > d. This proves that there exist at least d linearly in¬ 
dependent elements in 9 ?*; hence > d 2 ls required and = d h . 
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The relation = d h implies) of course, that > b. More¬ 
over, if ^** = dim 9 ?**，then 6 ** > > b. This result shows 

that 況 cannot be identified with the space of linear functions on 

EXERCISE 


1. (Mackey) Let 9 ? be a vector space over a field Prove that the collection 
of sequences = (7, 7 2 , 7 3 , • • •), 7 _ 0 in is linearly independent. (Note: 
This leads to an elementary proof of Theorem 2 for the commutative case.) 

6. Finite topology for linear transformations. We shall now 
introduce a certain topology in the set 2 ( 況 ， ©) of linear transfor¬ 
mations of the vector space 9 ? into the vector space Our 
topology will be a trivial (i.e., discrete) one if and only if 9 J is 
finite dimensional. Hence this gives another important point of 
difference between the finite and the infinite theories. 

We recall that a topological space consists of a set E and a col¬ 
lection of subsets of E y called open sets, such that 

1 . The logical sum of any collection of open sets is open. 

2 . The intersection of any finite number of open sets is open. 

3. The set E and the vacuous set are open.* 

A subcollection 93 of the set of open sets is called a basis if every 
open set is a logical sum of members of S 3 . If S3 is a basis) then 
the intersection of any two elements of S3 is a logical sum of ele¬ 
ments of S3. Conversely, if E is any set and S3 is a collection of 
its subsets such that their logical sum is E and the intersection of 
any two elements of 23 is a logical sum of elements of 23 ， then we 
can specify as open sets the logical sums of elements of 33. The re¬ 
sulting collection satisfies 1.-3.; hence it and the set E define a 
topological space. A set E is topologized if a collection of its sub¬ 
sets satisfying the above conditions is given. The collection of 
open sets is called a topology for E. 

Now consider the set ©)• If x 2y • • •, x m and y 2y 
• • - , y m are finite subsets of 9 ? and © respectively, then we define 
Oixi\ ji) to be the set of linear mappings A into © such that 
X{A = yi y i = 2， • •. ， m. It is clear that the intersection of 

any two 0 (xi ； yi) is another one. Hence this collection serves as 

* Throughout our discussion we shall follow the terminology of Lefschetz’ Algebraic 
Topology, Chapter 1. 
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a basis for a topology in 8(9?，©)• We shall call this topology the 
finite topology of 2(9?，©)• We note now that any open set 0(x^; 
y { ) is either vacuous or it coincides with an open set yj) where 
the Xj are linearly independent. Thus, suppose ^1 ， ^2y • • •， 
is a maximal linearly independent subset of x ly x 2y • • •, x m and 

r 

let Xk = ^2 Pkj^j hold for 々 =r + 1， • • m. Then，unless 

y=i 

= 0(xi ； yi) is vacuous. On the other hand, if the condi¬ 
tions do hold, then 0(xi ； yi) = 0(xj ； yj) y j = 1 , • • • y r. This re¬ 
mark shows that the sets 0(xj ； yj) y Xj linearly independent ， con¬ 
stitute a basis for our topology. 

We can now see that the topological space S(9?，@) (endowed 
with the finite topology) is discrete in the sense that every subset 
is open, if and only if dt is finite dimensional. First，let SR have 
the finite basis e 2y • • 、 e n and let A 8 ©)• Then 0(^-; 

eiA) = : {A) so that A is an open set. It follows from 1. that every 
subset of ? ( 況 ， ©) is open. Next let dim SR be infinite. Then if 
Xi y …， is a linearly independent set，is a non- 
denumerable set; for we can supplement the Xj to a basis and 
there exists a linear transformation mapping the elements of a 
basis into arbitrary elements of ©. It follows now that every 
open set of S(9?，@) is non-denumerable; hence the topology is 
not discrete. 

We shall show next that 8(9?，@) is a topological group，that is ， 
that A — B is a continuous function of the two variables A^ B 
in 8(9?，©)• Finally，if 況 =© so that S = 2 (% 9?) is a ring，then 
8 is a topological ring in the sense that in addition to the con¬ 
tinuity of — jB we have the continuity of the multiplication 
composition. Let A and B be fixed elements of S(9?，©) and let 
0 (at z *; yi) be a member of the basis containing A — B. Such a 
set will be called a neighborhood of the point. Since A — B ^ 
0 (xi ； yi) y we can write yi = Xi{A — B) so that 0 (xi ； yi) = 0(xi ； 
Xi{A — B)). Now 0(xi ； XiA) and 0 (xi ； XiB) are neighborhoods 
of A and B respectively and it is clear that if X e XiA) and 
Y e 0 (xi ； X{B) y then X — Y e 0(x^; Xi{A — B)). This proves 
that the difference composition is continuous. 

Next let 9? = @ and let 0 (xi ； XiAB) be any neighborhood of 
AB. Then 0(xi ； XiA) and 0{xiA\ XiAB) are neighborhoods of A 
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and B respectively. Moreover, X z 0(x {； XiA) and Y e 0{xiA\ 
XiAB\ then XY e 0(xi ； X{AB). Hence multiplication is a con¬ 
tinuous composition. 

We recall that a subset of a topological space E is called closed 
if its complement is open. The closed sets satisfy conditions dual 
to 1.-3. In particular，the intersection of any number of closed 
sets is closed. Hence any subset S oiE has a closure Cl S defined to 
be the intersection of all the closed sets containing S. (Since E 
itself is closed，there exist closed sets containing S.) The closure 
of S can also be defined as the totality of points p (elements of E) 
with the property that every neighborhood of p has non-vacuous 
intersection with S. We shall now illustrate these concepts in 
the finite topology for linear transformations by considering the 
following 

Example. Let 9? be a vector space with a denumerable basis (~) over an in¬ 
finite field Let (a t *) be a denumerable set of distinct elements in $ and let A 
be the linear transformation such that eiA — a^i. We wish to determine the 
closure Cl of the set of polynomials in A. We observe first that the sets 

O ⑺ (5) = 0(ej ； ejB)，j = 1 ， 2,… ， r, r = 1, 2, ...，form a complete set of neigh¬ 
borhoods of the point B y that is, any open set containing B contains one of these 
sets. Let 0(xk ； XkB), Xk linearly independent, be a neighborhood of B. Then 
there exists an r such that the given Xk 8 [e\, . • . ， e r ]. It follows that 0 ⑺ (5) 

C 0(xk ； XkB) and this proves our assertion. It is now clear that an element B is 
in the closure of a set M if and only if every set 0(^-; e 3 -B) meets M. Now let 
5 8 Cl ^[A]. If 0( 入 ） is a polynomial, then ei(j>{A) = Thus if (f> ( 卢 ） e ◦ ⑺ (5 )， 

then ejB = forj = 1, • • •, r. This shows that 5 is a diagonal 

linear transformation in the sense that e‘B = i = 1, 2, .... We wish to 
show that Cl ^[A] is identical with the set of diagonal linear transformations. 
Let B be any diagonal linear transformation and let r be any integer. Consider 
the transformations induced by B and by the polynomials (j>{A) in [e±, e% • • • ， e r \- 
Since the ai are distinct, it is easy to see that the induce every diagonal 
transformation in our subspace. Hence there exists a such that ejB = 

e^{A) holds (or j = 1 ， 2， • • •, r. This shows that 5 e Cl ^[A\. Thus Cl ^[A\ 
is the set of diagonal transformations. 

EXERCISES 

1. Let 9i be a vector space with a denumerable basis ⑹ over a field. Deter¬ 
mine Cl ^[A\ where (a) aA = ei + i, i = 1, 2, . • •，and (b) e\A = 0, ei^\A — 

i = 1,2, .... 

2. Show that the basic open sets 0(xi ； yi) are also closed. (This implies that 
©) is a totally disconnected space in the sense that the only connected sub¬ 
sets of S(9?, ©) are points.) 

3. Prove that every finite dimensional subspace of linear transformations in a 
vector space over a field is closed in the finite topology. 
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7. Total subspaces of 9?*. Consider the subset 沉 0 * of 況 * of 
linear functions / whose matrices relative to the basis ⑹ are 
column finite in the sense that/( 穴） 〆 0 for only a finite number 
of /. Evidently this collection of linear functions constitutes a 
subspace of the conjugate space. For each i we define a linear 
function by the conditions 

⑹ ei^{e k ) = dik. 

Thus is the linear function whose matrix relative to the bases 
{ei) has a 1 in the i place and 0’s elsewhere. Hence it is clear 
that the form a basis for 況 0 *. Consequently dim = 
dim 5R. We now observe that 況 0 * is a total subspace of 5K* in 
the sense that, if u is any vector 〆 0 in 沉 ， then there exists an 
element/ 8 9 ? 0 * such that f{u) ^ 0 . Write u = ^ie {l + / 3 2 ^- 2 + • • • 
+ p m e im where A 〆 0 . Then ei*(u) = 〆 0 as required. 

We recall that a subset $ of a topological space is dense (in the 
space) if its closure Cl S is the whole space. We shall now show 
that a subspace of St* is dense in the finite topology of = 
8 ( 9 ?，△) if and only if 沉 ， is total. First，it is clear that, if is 
dense in 9?*，then 況 ， is total. Otherwise there exists a vector 
u 0 in 9 t such that g{u) = 0 for all g e dt f . Then /(u) = 0 for 
all / in Cl = dt*. On the other hand，we can use ^ as a vector 
in a basis, and then it is clear that there exists a linear function 
/ such that f{u) 7^ 0 . 

To prove the converse we make use of the following criterion 
for density of a subset of 2( 況 ， ©): A subset 21 of 2(9?，©) is dense 
in the finite topology if and only if for every ordered set x 2y 
… ， x m ) of linearly independent vectors in 9 ? and every ordered 
set (jiy y 2y •…， y m ) in @，there exists an e 21 such that XiA — 
yi for i = 1, 2 y m. The sufficiency of this criterion is clear 
from the fact that the sets 0(xi ； XiB) form a basis for the neigh¬ 
borhoods of B. The necessity follows from the fact that the com¬ 
plete set of linear transformations has the property stated in the 
criterion. If 9^ is a subspace of we can simplify the criterion 
further and show that is dense if, for any linearly independent 
finite set Xi y x 2y •••， of vectors in 9 ?， there exists a complemen¬ 
tary set of vectors Xi^ y x 2 * y • • •，in such that 

= d ip ij = 1, •••， 
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If this is the case and the i = 1 , • • •，are arbitrary elements 
of △，then the function / = e 況 ’ and f(x{) = Hence 

況 ， is dense by the foregoing criterion. We now prove the fol¬ 
lowing 

Lemma. If 欲 is a total subspace of 況 * and X\ 3 x 2y • • •，are 
any linearly independent vectors in then 9 ^ contains a set of vec¬ 
tors . • • ， x m ^ complementary to the Xi. 

Proof. If m = 1， this is clear; for, in this case, we can find an 
/ in dt f such that /(xi) = 〆 0. Then satisfies 

•^ 1 *(^ 1 ) = 1* Assume the result for m — \ vectors. Then，for 
Xi y x 2y • • • ， x m -\ we can find / 1 , / 2 ，• • •，/ w —1 in 9?’ such that 
fk(^i) = hi holds for k y l = 1 ， 2 ， . • • ，所 一 1. For any/s 況 ’ we 
define 

m — 1 

gM =/ 0 ) — ⑹. 

1 

Then ^ e 9 ? / and g(xi) = 0 for / = 1 ， 2 ， • • • y m — l. Also there 
exists an / in 9 ? / such that the corresponding g has the property 
g(^m) 7 ^ 0. Otherwise we have 

m — 1 

0 = g(x m ) =/(x m ) - J2/k(^m)f(x k ) 

1 

m — 1 

== fi^m 一 > : /* k(^rn)^k) 

1 

771 — 1 

for all / in SR' This implies that x m = ^2/k(^m)^k and contra- 

1 

diets the linear independence of the x 9 s. Now choose / so that 
g(x m ) = 7 7 ^ 0 and define 

•v 饥 * 0 ) = g(x)y~ x 

= f k^') 一 是 = 1 ， 2 ， . • ’）fH 1 . 

Then we can verify that the Xj* are complementary to the Xj. 
This lemma completes the proof of the following 

Theorem 3. A necessary and sufficient condition that a subspace 
of 9?* is total is that 说 f is dense in the finite topology. 
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If 9 ? is finite dimensional，the finite topology in is discrete. 
Hence the closure Cl 況 ’ = 9 ?’ for every subspace ^ of 9 ?*. It fol¬ 
lows that the only total subspace of is 9 i* itself. On the other 
hand，the example given at the beginning of this section shows 
that, for infinite dimensional 況， 5 R* contains proper total sub¬ 
spaces. 

EXERCISES 

1. Let 9? have a denumerable basis and let 況 ， be a total subspace of 
Show that there exists a basis (ui) for 9? which has a complementary set of vectors 
(ui*) in 況 ’ in the sense that Ui*(uj) = holds for i y j = 1 ， 2， • • 

2. (Mackey) Let 況 and be as in 1. Assume, moreover, that 3?’ has a de¬ 
numerable basis. Prove that 況 and 況 ， have complementary bases. 

3. Let 9? and 9?’ be as in 2., and let ⑹， (^*) be complementary bases. Show 
that the basis (fi) where f\ = e\ and /» = ei - for / > 1 has no complemen¬ 
tary set in 

8. Dual spaces. Kronecker products. Let 沉 ， be a total sub¬ 
space of and let x edt. Then the mapping/ —> x(f) = /(x) 
is a linear function on 況 ’， that is, it is an element of the conju¬ 
gate space 9 ?’* of 況 , . The mapping x —> x(f) is a linear trans¬ 
formation of into 9 ?’* and，since is total，this linear trans¬ 
formation is 1-1. Moreover, the image space is a total subspace 
of 況 ’*. Hence in a certain sense 況 and dt f are interchangeable 
in our discussion. As in the finite case the symmetry which is 
implicit in this situation can be made explicit by introducing the 
notions of a bilinear form and of duality between a left vector 
space and a right vector space. Thus, we shall say that the left 
vector space 9 ? and the right vector space 況 ， are dual relative to 
the bilinear form g(x y y f ) if this form is non-degenerate in the 
sense that g(z y y f ) = 0 for all jy’ e 沉 ’ implies that 2 = 0 and g(x y 
z f ) = 0 for all ^ e 9 ? implies that z r = 0. If 9 ?’ is a total subspace 
of 9 ?*，then 9 ? and 況 ’ are dual relative to the bilinear form s{x, f) 
= /(x) = x(f). On the other hand, if and 沉 ， are dual relative 
to g(x, y f ) y then each y f e defines a linear function g y ^{x) on 9 ? 
and the mapping y r g yf is 1-1 linear transformation of 
onto a total subspace of 況 *. Similarly ， g(x y y f ) can be used to 
define a 1-1 linear mapping of 9 ? onto a total subspace of 況’气 

The results on total subspaces can be carried over directly to 
dual spaces. In particular, each member of a pair of dual spaces 
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defines a topology in the other which corresponds to the finite 
topology in the conjugate space. Thus let 9f and 9?’ be dual and 
let 0(9?’）be the total subspace of corresponding to Then 
令 ( 況 ’） has a topology which is inherited from $R*: the open sets 
of 0( 況 ’）are the intersections of the open sets of 9?* with the set 
0(9?’)• (This is the standard subspace topology.) We can now 
use the 1-1 correspondence between 0( 況 ’）and dt f to transfer the 
topology of 0(9?O to a topology in The result that we obtain 
is that the open sets of 沉 ' are the logical sums of the basic open 
sets i = 1, ••• ， r，where 0(^-; 13 i) is the totality of 

y f e such that g{x^ y f ) = ft. We shall refer to this topology 
of as the ^-topology. In a similar fashion we can define an 

-topology for 9?. 

Let and 9 ?/ be dual relative to g(x y y f ). As in the finite di¬ 
mensional case，if @ is a subspace of 9?, we denote by 7(©) the 
subspace of 況 ’ of vectors y f which are incident to every ^ e @ in 
the sense that g(x y y r ) =0. In a similar manner we can associate 
with every subspace & of a subspace of j{&) of 9?. It is 
easy to establish the following rules : 

(i) If ©i 2 ©2, theny(©i) 

⑼ i0*(©i)) 3 ©1, 

(iii) KKm，))) = 7 (©!). 

The first two of these are evident. To prove (iii) we use (ii) for 
©1 replaced by J(©i). This gives J.C/C/(©i))) On the 

other hand, since i(i(@i)) 2 ©1, (i) implies that j(i0*(©i))) ^ 
y(©i). If (and hence is finite dimensional^ then the map¬ 
ping @ > j(@) is 1-1 of the lattice of subspaces of 9? onto the 

lattice of subspaces of 沉 ’. This need not hold for infinite di¬ 
mensional spaces. For example, let 況 ’ = 3i*，the complete con¬ 
jugate space. Then if 況 ， is a total subspace of 5R* distinct from 
況 *， then j(dV) = 0 = ^(9?*) in spite of 況 ’ 〆 9i*. We shall show 
that the ^-mapping induces a 1—1 mapping of the set of closed 
subspaces of 9? onto the set of closed subspaces of 況 , . 

We observe first that, if © is any subspace of then the bi¬ 
linear form g defines a bilinear form g connecting the space © 
and the factor space 一 y(@). We define g(x y y f ) y where y f = 
y r + i(@)，by g(x y y f ) = y f ). Since any two choices of y f are 
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congruent modulo it is clear that we obtain in this way a 

single-valued mapping of the set of pairs y f ) into A. We can 
verify directly that J" is a bilinear form. If x 〆 0 in then we 
know that there exists a jy’ such that g(x, y r ) ^ 0. Then g(x, y f ) 
〆 0 . On the other hand，assume that is a vector in — j(©) 
such that g(x y y f ) = 0 holds for all x in Then g(x,y f ) = 0 
for all and jy’ s)(©)• Thus y f = 0. These remarks show that 
the pair of vector spaces 況 ’ 一 y(@) are dual relative to the bi¬ 
linear form g. We can now prove the following 

Theorem 4 . If & is a subspace of fhen j{j(&)) is the closure 
of & in the ^-topology of in particular, & is closed ij and only 

i/JOW)) = 

Proof. It follows directly from the definition of the topologies 
that subspaces of the form )(©)"•(©’）are closed. Since )(/(©’)） 
2 @’ ， i(i(©’)）2 Cl ©’• Conversely, let u r ejO(© 0 ) and consider 
any neighborhood 0 (xi ； g(xi y u f )) of u’• Let 36 be the finite di¬ 
mensional space spanned by the Xi and let (九 y 2y …， y r ) be a 
basis for this space such that (Ji ， JV2，• • *, is a basis for j(&) 
fl 2 c. The cosets Jk — Jk 々 =j + 1， . • . ， r, are linearly 

independent in 一 ）(©’)• Since ©’ and 況 — j(&) are dual rel¬ 
ative to g(x + y ； ) = g(^ y J’)，we can conclude from the 

lemma of the preceding section that there exists a v f e & such 
that g(y k + j(&) y v f ) = gijky u r ) holds for 是 =j + 1， • • •， r. 
Thus g{y^ t) f ) = g{yky "’)• On the other hand, g{yj y v f ) = 0 — 
g(yh for j = 1, •••，』• Hence v f e 0 (yi ； g{y iy u f )). Now 
0 (yi ； g(yiy u’)）= 0 (xi ； g(x iy "’))，/ = 1 ， • • •, r. Hence v r is in 
the given neighborhood 0 (xi ； g(x iy u f )) of u f . This shows that 
u r e Cl @’； hence Cl ©’ = j{j{&)) as we wished to prove. 

Now consider the mapping @ j(©) where © ranges over 

the set of closed subspaces of 況 . Since = © for closed 

@，it is clear that our mapping is 1 - 1 . Since every closed sub¬ 
space of has the form & = the mapping is a mapping 

onto the set of closed subspaces of 9?’. This proves the assertion 
that we made before. 

The existence of a dual for any given vector space enables us 
to carry over the proof given in the finite case for the existence 
of a direct product group for any right vector space W and any 


256 


INFINITE DIMENSIONAL VECTOR SPACES 


left vector space @ (§ 1 ， Chapter VII). As before, let 9? be dual to 
況 ’ relative to the bilinear form g. Consider the set $ of linear 
transformations of dt into © which have the form 



where the x/ e 9J / and the yi z It is immediate that ^ is a 
subgroup of S(9?，©)• If x r 8 and jy e ©, then we define 〆 X jy 
to be the linear transformation x —> g(x y x f )y belonging to the 
group 史 . Then we can verify as in the finite case that ^ is a di¬ 
rect product group ， 屯 = 況 ’ X ©，of 況 ’ and 

This basic definition permits us to carry over much of our 
previous discussion of direct products. In particular we can use 
it to define the Kronecker product of arbitrary vector spaces 
over a field and the Kronecker product of arbitrary (non-associa- 
tive) algebras. Also we can define the extension space 9 ?^ for 9? 
arbitrary and 2 any extension field of the base field 中 of 9?. The 
proofs of the elementary properties such as commutativity and 
associativity of Kronecker multiplication made no use of finite¬ 
ness; hence these hold in the general case. 

EXERCISES 

1. Prove that, if © is a closed subspace of 9? (in the SJ^-topology) and ^ ls 
finite dimensional, then © + § is closed. 

2. Let 5 be a finite dimensional vector space over a field 伞 and let 9? be an 
arbitrary vector space over 中 . Show that X 5 ,況 X 5) is the Kronecker 
product of ?(9?, 9?) and ?(3, 8) relative to A X B defined as on p. 211. 

3. Show that the result of Ex. 2 does not hold for infinite dimensional 3 ?， 

4. Let {9? a } be a collection of subspaces of a vector space 9? over a field 伞 and 
let S be an extension field of Prove that ( fl 9?«)s = H 3t a z holds in 況 s. 

9. Two-sided ideals in the ring of linear transformations. As 

in the finite case we define the rank p{A) of a linear transforma¬ 
tion A as the dimensionality of the image space 说 A. Similarly 
the nullity v{A) is the dimensionality of the null space ^ of 
vectors z such that zA = 0 . If dti is a complement of SHa so 
that 沉 = 9 ?i ㊉ 9 ^， then ^ is a 1-1 mapping of 況 ！ onto = 
9 ?^. Hence dim — dim and this implies, as before，that 
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p{A) + v{A) = dim 況 . Also we can easily prove the following 
important relations : 

1. p(yf + 5 ) < p{A) + p(B). 

2. p{AB) < min p(B)). 

These formulas allow us to define certain proper two-sided 
ideals in the ring 2 of linear transformations of an infinite di¬ 
mensional vector space. Let e be any infinite cardinal such that 
e < b = dim dt and let 2 e be the set of linear transformations A e 
such that 

p{A e ) < e. 

Since p(—A e ) = p(yf e ), 2 e contains the negative of every linear 
transformation in this set. Also since the sum of two cardinals ， 
one of which is infinite，is the larger of the two cardinals we see 3 
using 1.，that is closed under addition. Finally 2. shows that 
S e is closed under multiplication by arbitrary elements of 2 - 
Hence is a two-sided ideal. 

If e and 〆 are two infinite cardinals < b and e < e\ then 

匚 S e '; for evidently S e £ Moreover, there exist linear 
transformations of any given rank < b\ for we can obtain such 
transformations by choosing a basis {ei) of SR and a subset (e^) 
which has the given cardinal number. Then the linear transfor¬ 
mation such that e k —> and ei 0 for i 9^ k has the required 
rank. Now the linear transformations of rank e are in but 
not in ? e . Hence 2 e 9^ 2 e f and 2 e ci Thus we see that the 
correspondence <? —> is 1-1. 

The main result on two-sided ideals of 2 is that the ideals 2 e 
are the only proper two-sided ideals in 2 . For the proof of this 
fact we require the following 

Lemma. If A and B and p(B) < then there exist P 

and Q in 2 such that B - = PAQ. 

Proof. We write 況 = 9?i ㊉ 沢汲 where ^Ia is the null space of 
A and similarly = 況 2 ㊉ ％ b. Let (x k ) be a basis for 3^ and 
(yx) be a basis for 況 2 . Since dim dti = dim "StA > dim = 
dim 況 2, we can set up a 1-1 correspondence y\ x\ of (jy x ) into 
(Xk). Let P be the linear transformation which maps y\ into 
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and maps 31 b into 0. Since the vectors x\A form a linearly inde¬ 
pendent set, there exists a linear transformation Q such that 
(x x J)Q = y\B. Then 

y\PAQ = x x JQ = y x B y 
zPAQ = 0 if 2 8 SSIb- 
Hence PAQ = B as required. 

Suppose now S3 is any proper two-sided ideal in S. Let e be 
the smallest infinite cardinal number such that e > p{B) for all 
5 8 S 3 . If 93 contains a linear transformation B of rank b — 
dim 9? and A is any linear transformation of 況 ， then rank A < 
rank B. Hence by the preceding lemma, A = PBQ e S. Thus 
^8 = 2 contrary to hypothesis. Thus b > p{B) for every 5 e S3 
and therefore e < b. Since e < the definitions show that 
S3 C ? e . On the other hand，let C be any element of S e . Then 
p(C) < / and if p(C) is infinite there must exist a 5 e S3 such that 
p{B) > p(C). By the lemma this implies that C e 53. If p(C) is 
finite，we can argue in the same way that C is in 93 unless p(C) 
> p(B), for every B. At any rate we can conclude that S con¬ 
tains every linear transformation of rank one. We shall now 
show that any transformation of finite rank is a sum of transfor¬ 
mations of rank 1. To prove this we write 5KC = [yi ， JV2，• • Jw] 
where the yi are linearly independent. Then for any x 

xC = 0lO ) 力 + <j> 2 (x)y 2 H - h 

It is clear that the are linear functions and that the map¬ 

ping Ci such that xCi = <i>i{x)yi is a linear transformation of rank 
one. Evidently C = C x + C2 + * ••+ C m and, since we know 
that the Ci e S 3 , we see that C e 33. Thus every C in 2 e is in 93 
and S3 = This proves 

Theorem 5. Let 2 be the ring of linear transformations in an 
infinite dimensional vector space SR. For each infinite cardinal e < 
dim define 2 e to be the totality of linear transformations of rank 
< e. Then 2 e is a proper two-sided ideal in 2 and any proper two- 
sided ideal coincides with one of the 2 e - 

We have seen that, if e and 〆 are two infinite cardinals < b 
and e < e\ then S e [ Theorem 5 therefore shows that the 
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correspondence e is a lattice isomorphism of the set of in¬ 

finite cardinals < b on the set of proper ideals in 2 - In particular 
we see that 8 has at least one proper two-sided ideal, 2 e where e 
is aleph null. This ideal consists of the transformations of finite 
rank and in the sequel we denote it as Clearly g is contained 
in every two-sided ideal ^ 0 of 2 - 

10 . Dense rings of linear transformations. Some of the results 
on the ring of linear transformations of a finite dimensional vec¬ 
tor space can be extended to arbitrary dense rings of linear trans¬ 
formations. We recall that a set 21 of linear transformations is 
dense in the finite topology if and only if for any two ordered 
finite sets of vectors ( 巧 ， • • • ， x m ) y (y u y 2y - - •, jy m ) such that 
the x y s are linearly independent，there exists an ^ e2l such that 
XiA = yi, i = 1, 2, • • 、 m. 

We note first that any dense ring 21 of linear transformations 
is an irreducible set of endomorphisms. By this we mean that 
the only subgroups of the additive group 況 which are mapped 
into themselves by 21 are 9 ? and 0. Thus，let @ be such a sub¬ 
group. If © ¥ 0， it contains a vector x 9^ 0. Then if y is any 
vector in 沉 ， we can find an ^ e2l such that xA = y. Hence 
j e ©. Since y is arbitrary this shows that © = 5R. 

Another noteworthy result on dense rings is that the only endo- 
morphisms of the group 況 which commute with every J are 
the scalar multiplications. This is an extension of Theorem 2 of 
the preceding chapter. The proof of the earlier result carries 
over word for word to the present situation. 

It appears to be very difficult to construct and to classify all 
dense rings of linear transformations. However, a good deal can 
be done for an important subclass of the class of dense rings, 
namely, those which contain non-zero transformations of finite 
rank. In the remainder of this section and the next two sections 
we shall be concerned with the theory of rings of this type. 

We give first a method for constructing such rings which will 
turn out to be completely general. We begin with a total sub¬ 
space 9 i / of the conjugate space 9J* and we let 2( 況 ’ | 9?) denote the 
totality of linear transformations A whose transposes map 9?’ 
into itself. We recall that A* is the linear transformation / JA^ 
where JA^{x) = Now let <t>u <t> 2y • * *, <t>m be arbitrary 
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elements of Ui 9 u 2y • • • ， u m arbitrary vectors in 況 and let 

m 

F = H 小 i X Ui ， We recall that this means that F is the linear 

1 m 

transformation x ^ Thus F is of finite rank. More- 

l 

over, if /is any linear function，then fF*(x) = Thus 

/F* is a linear combination of </> 2 , • • • ， <t> m and hence i 7 * e 
I 況 ). This shows that 8 ( 9 ^ | 沉 ） contains non-zero transfor¬ 
mations of finite rank. Let 5( 況 ’ | 況 ） =S 门 | 9 ?) the to¬ 
tality of finite rank transformations contained in 2( 況 ’ | 9i). 

We prove next that 5( 況 ’ 丨況 ） is dense in 2 . Thus let {y u y 2y 
• • • ， JVw) be linearly independent and let (u^ u 2y • • •，" w ) be arbi¬ 
trary in 9J. Since is total, it contains linear functions <t>i such 
that = ^ij y i y j = 1 ，2 ， • • 、 m. Then the linear transforma¬ 

tion F = Z(f>i X Ui e g (況 ’ I 況） and yiF = i = 1 , • • •, as 
required. 

It is clear from the definition of ? ( 況 ’ | 9?) that this set is a sub¬ 
ring of S = ?( 況，況 ）（=I dt)). Likewise g( 9 ? / | 9?) is a sub¬ 
ring of S. Now let 21 be any subring of S( 9 ?’ | 況 ） which contains 
g( 況 ’ I 9 ?). Then since g ( 況 ’ | 9?) is dense，21 is dense. Also obvi¬ 
ously §1 contains non-zero transformations of finite rank. 

Conversely, let 21 be any dense ring of linear transformations 
such that H 门 g 〆 0. Let SR 7 be the subspace of 9?* defined by 

(7) 況 ’ =Z 況 

尸 e 21 n 5 

that is, dt f is the smallest subspace of 9?* containing the spaces 
9 ?*^* where F §. Then we shall show that 9?’ is total and 
that I 9?) £ 31 C 8( 況 ’ I 況 ). The totality of 況 ’ will follow 

from the following lemma which is of interest in itself. 

Lemma 1. If % is an irreducible ring of endomorphhms, any 
non-zero two-sided ideal of % is irreducible. 

Proof. If x is a non-zero element of the group 況 in which 31 
acts，then the set of elements xB y B in S3, is a subgroup in¬ 
variant relative to 21. Hence either = 況 or = 0. If ^33 
= 0， then the collection @ of x’s with this property is not 0. 
But © is a subgroup invariant relative to 21 also. Hence @ = 
Thus = 0 contrary to S 3 # 0 . We have therefore proved 
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that ^33 = SR holds for every non-zero x. The irreducibility of 
relative to S3 is an immediate consequence of this result. 

We can now prove that the space 況 ， defined by ( 7 ) is total. 
We know that g is a two-sided ideal in 2 . Hence g fl 21 is a non¬ 
zero two-sided ideal in 21 so that by Lemma 1 g 门 SI is irreducible. 
If % 〆 0 is in 9 ?， then we can find an i 7 e g D SI such that xF ^ 0 . 
Also we can find a linear function / such that f{xF) ^ 0 . Then 
fF^{x) 9^ 0 and /_F* e 9?’. Hence is total. 

Now let yf eSI. Then we have the following relations 

= 2 況气 F*/* = S9i*(^F)*c 

since g 门 21 is an ideal in 21. Hence we have proved that 31 C 
S(9? / I 況 ). In order to prove the other inclusion relation g(9i / | 9i) 
C 21 we require the following 

Lemma 2. Let F be a transformation of finite rank and let 
dtF = [ui y u 2y • • • ， u m ] where the Ui are linearly independent. Then 

m 

F can be written in one and only one way as ^ cj>i X Ui where the 

i 

cj>i e 5K*. Moreover, the (fn are linearly independent and 況 ’^ 7 * = 
[0i ， 02， • • • ， <t>m\ holds for every total subspace of $R*. 

Proof. We have seen before (p. 258 ) that F has the form 

m 

yi <j>i X Ui. The uniqueness has also been noted previously in 

l 

our discussion of direct products (p. 201 and p. 256 ). Thus the 
first statement of the lemma holds. Now let / e 5R*. Then 
/F* = ; hence C [0 U </> 2> …， On the other 

hand, if is dense，then we can find gi in such that gi(u /)= 
dij. Then giF* = <t>i so that <j>2 y • • •, <t>m\ Q dt f F*. This com¬ 
pletes the proof. 

Now let F e 1 9 ?) and write F = X Ui where the Ui 
form a basis for dtF. Then dt’F* = [</>i ， 洽 2， • • *, <t>m] so that the 
<t>i 8 Thus all the 和 e 況 * 八 * + + • . • + 沉 * 凡 * for 

suitable Fj e % C\ g. We apply the preceding lemma to the Fj 
and write Fj = ^ \pj k X Vj^ where the Vjk form a basis for dtFj 

k 

and the \f/jk form a basis for 況 *^ 7 ；*. Then 0^ = for 
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suitable in A. Since 21 is dense and the Vjk for fixed j are 
linearly independent, we can find Aji e 21 such that 

( 8 ) Vj k Aji = 

for k = 1 , 2 y •••，/ = 1 ，2， m. Now the transformation 
2 FjAji e g fl 21 and 

j，i 

2 FjAji = (^2 ^jk X Aji = X ^jk X Vj k Aji 

j,i j,i \ k / i,j,k 

^ J2 ^jk x Pjk，iUi = ^ (Yl x Ui 

i,j,k i \ j，k / 

= Xcj>i X Ui = F. 

Thus i 7 e g fl 21. This completes the proof of the following struc¬ 
ture theorem. 

Theorem 6. Let be a total subspace of 9?* and let 2(9? / | 9?) 
be the totality of linear transformations A whose transposes map 
into itself. Then any subring% | 9 J) which contains 3 ( 況 ’ 丨 9 ?) 

=g fl S($R / I SK) is a dense ring of linear transformations contain¬ 
ing non-zero transformations of finite rank. Conversely^ any dense 
ring of linear transformations which contains non-zero finite rank 
transformations can be obtained in this way. 

Our arguments actually establish somewhat more than we have 
stated in the theorem. Thus we have the formula ( 7 ) for the 
total subspace di ; determined by the given ring 21. Moreover, it 
is easy to see from our discussion that g($R / | 9 f)= 沉 ’ X 9 ? the 
totality of mappings X Ui y cj)i e U{ e 9?. If we begin with 
a ring between S(9J / | 9?) and g($R / | 3i), then the space determined 
by ( 7 ) is 9 t’ itself. We leave the verification of these statements 
to the reader. 

The main theorem can also be formulated in a more symmetric 
fashion in terms of dual spaces. For this purpose let 9? and 9x r 
be dual relative to the bilinear form g. Then we have the natural 
equivalence R of onto a total subspace 0* of 5 R*: If y f e 9 ?’， 
then y f R is the linear function g y >{x) = g{y\ x) (cf. p. 137 ). If 
A e ?(©* I 9 ?), then A f = RA^R~ l is a linear transformation of 
dt f into itself. We shall call A r the transpose of A relative to g. As 
in the finite dimensional case, A r satisfies the condition 

⑼ g^A.y 1 ) = g(x y y f A f ) 
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for all ^ 8 9? and all y f e 9? 7 . Conversely, let A be any linear 
transformation in 9i for which there exists a linear transformation 
A f in such that ( 9 ) holds. Then g y ^* = gy>A> e ©* so that 
A e S(©* I 5R). It follows that A 1 is the transpose of A relative to 
g. It is now natural to denote S(©* 丨 9 ?) also as ?( 9 ?’ 丨 5 R). The 
transformations of finite rank in this ring have the form 2 jy/ X Xi 
where, as usual, this denotes the mapping x —> y/)xi ， The 

transpose in 況 ’ of 2y/ X Xi is Sjy/ X ; Xi where X X{)= 

jy’). Hence the sets g ( 況 '| 5 R) = 5 A S ( 況 ’ | 沉 ） and 
5 ( 況 I 9?0 (defined in the same way) correspond in the mapping 
A — A r . 

The dual space formulation of Theorem 6 can now be given. 

Theorem 6’. Let dt and dV be dual vector spaces and /et 2 (dt f | 9 ?) 
denote the totality of linear transformations in 5K which have trans¬ 
poses in Then any subring <9/?( 況 ’ 丨 9 i) which contains | 9?) 
=g fl S ( 況 ’ I 9?) is a dense ring of linear transformations in 9? con¬ 
taining non-zero transformations of finite rank. Conversely，any 
dense ring of linear transformations which contains non-zero finite 
rank transformations can be obtained in this way. 

It is clear from this formulation that the set 2T of transposes A r 
in 9T is a dense ring in 9?/ containing transformations of finite 
rank. The mapping A A f is an anti-isomorphism of 21 onto 

2T. 


EXERCISES 

1. Let SR have a denumerable basis over A and let 21 be the totality of linear 
transformations whose matrices relative to this basis have the form 


'A O' 

.0 0 . 

where yf is a finite matrix. Show that SI is a dense ring. 

2. Let 9? be as in 1. and let 況 ’ be the total subspace <j> 2 , • • •] where <t>%{ej) 
= 8ij for {ej) a basis. Show that A 8 ?( 況 ’ | 況 ) if and only if its matrix relative to 
{ei) is both row finite and column finite. 

3. Let U and V be the linear transformations in 9? over 伞 whose matrices are 


*0 1 
0 0 1 
0 



o - 


1 0 


0 1 0 

9 

1 - 

• 

• • 

- 

• 

- * - 
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Show that the algebra ^>[C7, V\ generated by U and V \s dense and contains trans¬ 
formations of finite rank. 

4. Verify that, if the vectors (<?») and (0 t ) are complementary (<t>i(ek) = ^ik), 
then the linear transformations eik = <t>i X ek satisfy the multiplication table for 
matrix units. 

5. (Litoff) Prove that any finite subset of 5( 況 'I 況 ） can be imbedded in a sub¬ 
ring which is isomorphic to a finite matrix ring A n . 

6. Prove that any right ideal of 巧 ( 況 ’ 丨 9?) = 9?’ X 9? has the form X 9? 
where is a subspace of ^ and that any left ideal has the form 9? r X © a 
subspace of 9?. (Cf. § 3-4 of Chapter VIII.) 

7. Prove that 匕 ⑼’ | 況 ) is simple. 

8. Prove that A has a transpose in 9i / if and only if is a continuous mapping 
of 9?, endowed with the 9?’-topology，into itself. 

11. Isomorphism theorems. We take up now the question of 
isomorphism of dense rings of linear transformations containing 
non-zero transformations of finite rank. For this purpose we 
shall use the structure theorem in its original form, namely, that 
21 can be sandwiched in as | 9 f) 3 21 2 5 ( 9 ?’ | 9 ?) where 9 ?’ is 
a total subspace of 9i*. We have seen (Ex. 6) that every right 
ideal of g(9? / | 9?) has the form ©’ X 況 where & is a subspace of 
況 , . Now if A is any linear transformation in dt y then (Zxpi X Xi)A 
='Sxpi X XiA. Hence X 9 ? is in reality a right ideal in S and 
a fortiori in 21. If & = [\p] is a one-dimensional subspace of 況 、 
then it is clear that X 9 ? is a minimal right ideal of 3 ( 9 ?’ | 0 ?). 
Since it is clear that any right ideal of 21 contained in 5 ( 況 ’ | 9 ?) is 
a right ideal of g( 9 ? / | 9 ?)，our remark shows that [^] X 況 is a 
minimal right ideal of §1. 

We can now list the following facts about 21: 1) 31 is an irreduci¬ 
ble ring of endormophisms in 況， 2 ) the set of endomorphisms 
which commute with every ^ in 21 is the set of scalar multiplica¬ 
tions, and 3 ) 21 possesses minimal right ideals. These results en¬ 
able us to carry over the discussion in § 5 of Chapter VIII on the 
isomorphism of rings of linear transformations of finite dimen¬ 
sional vector spaces. 

We sketch the argument that we used before. Let 3 be a 
minimal right ideal in H and let ^ be a vector such that ^ 0. 
Then is a subgroup of 沉 mapped into itself by 21 . Hence xQ 
= 9?. We can conclude as before that the mapping 乂 •• B — xB 
is an operator isomorphism of 3 onto 9?. 
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We now consider two isomorphic rings 21 i = 1, 2, where 
S(3i/ I dti) 2 I and is a vector space over dt/ 

a total subspace of linear functions in 9^. Let A x be an 

isomorphism of 2Ii onto H 2 . Choose a minimal right ideal 3i in 
2ti and let 3 2 = 3i0. Let 么 be an operator isomorphism of 
into 況 i determined as above. Then by the argument of § 5, 
Chapter VIII， the mapping U = is a 1-1 semi-linear 

transformation of 9?i onto 9i 2 and 

(10) — U~ X A\U 

holds for all A\ in 2li. In particular we see as before that the 
base division rings are isomorphic and 9ii and 況 2 have the same 
dimensionality. 

In the finite case this is all one needs to say. In the infinite 
case, however，there is an important additional remark which 
should be made. This concerns the transpose of the semi-linear 
transformation U. We proceed to define this concept for any 
semi-linear transformation. 

Let S be any semi-linear transformation of 9?i into 5R 2 and let 
s be the isomorphism of Ai onto A 2 associated with S. Then 
(aXi)S = for any Xi in dti- Now let f(x 2 ) be any linear 

function in and set 

Then it is clear that ^ is a linear function on 9?i. Also it can be 
verified directly that the mapping S*: f g is a semi-linear 
transformation of 9? 2 * into with associated isomorphism 

j— 1 . We call S* the transpose of S. As for linear transformations 

(11) (s x s 2 r = w. 

This implies that, if S has the inverse 6*— 1 (a semi-linear transfor¬ 
mation of 況 2 onto with isomorphism s~ x ) so that ^ -1 = 1 
=then 6**(6*-= 1 = Hence S* also has an 

inverse. This is equivalent to saying that, if S is a 1-1 mapping 
of 9ii onto 9?2, then S* is 1-1 of 沉 2 * onto 9?i*. We observe that 
Fi is a transformation of finite rank in 3^ if and only if U - 1 FiU 
is of finite rank in 5R 2 . It follows that (j> maps g(9V | 況 1 ) onto 
g(3f 2 / I 況 2 ). If we refer to formula (7) for the 9?/， we can verify 
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that C7* maps 9? 2 ’ onto Thus ， 

dt 2 'U* = 

= 2 ^ 1 *^!* = dh\ 

We can therefore state the following isomorphism theorem : 

Theorem 7. Let i = W be a vector space over and let 
9i/ be a total subspace of linear functions on 8?. Suppose that is 
a subring of S ( 況 / | 队 ） containing g(9f/ | dti) and let <j> be an iso¬ 
morphism o/^i onto H 2 . Then there exists a 1—1 semi-linear trans¬ 
formation U of dti onto 況 2 , whose transpose maps 9t 2 ’ onto 9?i ’， such 
that Ai(j> — U - 1 AiU holds jor all A\ in §li. 

This theorem has a number of interesting consequences. We 
give one of these here, a generalization of Ex. 5, p. 237. 

Corollary 1. Let ^ be a vector space over a field 电 and let be 
a total subspace of 9?*. Then every automorphism of | 3?) 
which leaves the elements of the center fixed is inner. 

Proof. Evidently | 9J) contains the set% of scalar multi¬ 
plications. Also since the only endomorphisms which commute 
with all the elements of ? ( 況 ’ | 況 ) are the scalar multiplications, 
the set is the center of ? ( 況 ’ | 沉 ）. If yf —> A<i> is an automor¬ 
phism in S(9i’ I 9?)，then there is a semi-linear transformation U 
such that A<t> = U~ l AU. If u is the associated automorphism 
in then U~ l aiU = {a u )i ， Assume now that ai4> = a\ for all 
a. Then U~ l aiU = ai<f> — ai ， Hence a\ = {a u )i and so " = 1. 
Thus U is linear. Since U* maps 9? / into itself, U e | di) by 
definition. Thus 0 is inner. 

This result includes, of course，the following special case: 

Corollary 2. Every automorphism of the ring 2 of linear trans¬ 
formations of a vector space over a field which leaves the elements of 
the center fixed is inner. 

EXERCISE 

1. Let A be any division ring with the property that the only automorphisms 
in A leaving the elements of the center fixed are inner. Prove that, if 9? is a vec¬ 
tor space over A, then every automorphism of a ring | 9?) which leaves the 
elements of the center fixed is inner. 
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12. Anti-automorphisms and scalar products. We consider now 
the problem of finding conditions that a dense ring of linear 
transformations containing non-zero transformations of finite 
rank possess an anti-automorphism. It is convenient to assume 
here the second formulation of the structure theorem, that is, 
that 21 is given as a subring of ?( 況 ’ | 5R) containing g ( 況 ’ | 9?) 
where and 9^ are dual relative to a bilinear form g. We intro¬ 
duce the division ring A 7 anti-isomorphic to A and let a 
be a fixed anti-isomorphism of A onto Then we can regard 5K 
as a right vector space over A 7 if we take xa 1 = ax. Similarly, 
is a left vector space over A r if a l x f = x f a. 

Now suppose that A —> is an anti-automorphism in 21. If 

A f denotes the transpose of A relative tog, then A —» A r is an anti¬ 
isomorphism of % onto a ring ST and S (況 | 9?’）2 21’ 2 5 ( 況 | 況 ’)• 
It follows that the mapping A f — is an isomorphism of ST 
onto 21. Hence by the isomorphism theorem there exists a semi- 
linear transformation V of the left vector space 況 ’ (over △’）onto 
the left vector space 9? such that 

(12) = V~ x A f V 

holds for all A z%. The semi-linear transformation V can be 
used to define a scalar product in SR; for we can put 

(13) h{x,y) = g{x,yV~ l ). 

Then it is clear that 

h{x l + x 2y y) = h{x u y) + /i(x 2y y) 
h{x y y x +y 2 ) = h{x y y x ) + h{x,y 2 ) 
h(ax y y) = ak(x y y). 

Moreover, 

h(x y ay) = g(x, (ay)V~ x ) = g(x y a \y^~ 1 )) 

= 咖，(，-”广 1 ) = g(^yF^)a v ~ lrl 

= h(x,y)a v ' lrl 

where v is the isomorphism of onto A associated with V. Since 
v~ l is an isomorphism of A onto △/ and 厂 1 is an anti-isomorphism 
of onto A, y _1 厂 1 is an anti-automorphism in A. We write 
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a = a ; hence h(x y ay) = A(x^ y)a and h is a scalar product in 
9? relative to a —> a. 

It is easy to see that the non-degeneracy of g and the proper¬ 
ties of V imply the non-degeneracy of h. Hence if we regard 
as a right vector space over A by taking xa = ax y then 況 is dual 
with itself relative to h. We prove next that 21 is a subring of 
2(5R I 9?) containing g(5R | 9?). Thus if ^ e 21, then 

h{xA^ y) = yV~ x ) = yV~ l A f ) = g(x y yV~ l A f W~ l ) 

=yA^V~ x ) = h(x y yA^). 

Thus A e 2(9? | 9J) and its transpose relative to h is the image 
under the given anti-isomorphism. On the other hand, let 
F 8 g(9? I 9?). Then 

g{xF y y f ) = h{xF^y f V) = h{x^ y r VF^) = h{x y VF^V^V) 

hence F has a transpose relative to g and i 7 e SI. We have there¬ 
fore proved that S (況 | 況 ） 2 H 2 5( 況 | 況） and that A —> is 
the transpose mapping relative to h. 

We have not yet fully exploited the fact that e 21. We 
shall show next that this condition implies that h(x y y) is a weakly 
hermitian scalar product in the sense that there exists a 1-1 semi- 
linear transformation ^ of 9? onto itself such that 

(14) h{x, y) = h{y, xQ) 

holds for all y edt. Consider the mapping y x X that is, 
x — h{x y yi)xi ， We know that this belongs to 5 ( 況 | 況 ） and 
that its transpose isjy —> yih(xi y y) = h{xi y y) a yi where a —> a a is 
the inverse of a —> a. Since the transpose mapping sends 21 into 
itself, y —> h(x ly y) a yi coincides with a linear transformation 
'hui X A simple argument shows that in reality our transfor¬ 
mation has the form X yi- It follows that h(x ly y) a = h{y y Zx) 
holds for ally. If we take the bar of both sides，we obtain h{x u y) 

= h(y y Zi). Thus for each x there exists a z such that h(x y y) 

= h{y^ z) holds for all y. Now the non-degeneracy of h implies 
that z is uniquely determined by x; hence ^ > 2 ； is a mapping 
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Q of ^ into itself. Clearly Q is an endomorphism. Moreover, 
h{aXy y) = ah{x y y) = ak(y ， xQ) = h 、 y 、 xQ)a a 

=Ky ， a a \xQ)); 

hence (ax)Q = a° 2 (xQ) and Q is semi-linear with associated auto¬ 
morphism a 2 . The non-degeneracy of h implies that Q is 1-1. 
Finally, since every element of g (況 | $K) is a transpose，(J is a map¬ 
ping onto 5R. This proves that h is weakly hermitian. 

Conversely, assume that A is a non-degenerate weakly her¬ 
mitian scalar product in 況 over A. Let A e | $K) and let A f 
now denote its transpose relative to h. Then ， 

h{xA\y) = h[yQ - \ xJ f ) = hiyQ^A, x) 

= h{x,yQ~ x AQ). 

Hence h{xA\y) = h{x y yQ~ x AQ). This shows that A f e 2(9? | 5R) 
and that A n = Q - 1 AQ • Hence A A f an anti-automor¬ 
phism of I 9?). We can summarize our results as follows : 

Theorem 8. Let % be a dense ring of linear transformations in 
dt over A containing non-zero transformations of finite rank. As¬ 
sume that SI possesses an anti-automorphism A Then A 

has an anti-automorphism a —> a and there exists a non-degenerate 
weakly hermitian scalar product in dt such that SI is included between 
S(5R I 9?) and g (況 | 況 ） and such that A —> coincides with the 

transpose mapping relative to h. Conversely y if 说 has a non-degen¬ 
erate weakly hermitian scalar product、then the transpose mapping in 
I 5R) is an anti-automorphism. 

We impose next the condition that A A f {= A^i) is involu- 
torial, that is, that A f, = A holds for all A z%. By the relation 
A" = Q~ l AQ derived above, our condition is equivalent to 
Q~ l AQ = A for all A z%. The latter holds if and only Q = 
lii a scalar multiplication. Thus A —^ A r is involutorial if and 
only if 

(15) h{x y y) — vh{y y x) 

for a fixed v(= p.) and all y. We shall now show that we can 
replace A by a suitable multiple s(x y y) = h{x y y)r which is either 
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hermitian or skew hermitian. We note first that iteration of (15) 
gives 

(16) h{x y y) = vh(x y y)v. 

If we choose x y y so that h{x^y) = 1, this gives v = v~ x . If 
v = — 1，々 is skew hermitian and there is nothing to prove. If 
v 9^ —1, then we set r = {y + 1) —1 and we verify that 

t - 1 亍 =(^ + 1)(^ + l) -1 = (^ + + l) -1 = v. 

Then if s(x y y) = h(x y y)r y we can verify that j is a scalar product 
whose anti-automorphism is a —> a* = r~ 1 dr. Also 

s(y y x)^ = r~~ l s{y y x)t = x)t 

= vh{j, x)t = h{x y y)r = s(x y y )； 
hence s is hermitian. We have therefore proved the following 

Theorem 9. Let 21 and ^ be as in Theorem 8, and assume that 
伞 2 = 1. Then A has an involutorial anti-automorphism and there 
exists a non-degenerate hermitian or skew hermitian scalar product 
s in dt such that A — coincides with the transpose mapping rela¬ 
tive to h. Conversely^ if 9 ? has a non-degenerate hermitian or skew 
hermitian scalar product y then the transpose mapping in | 3?) is 
an anti-automorphism. 

We remark also that in view of Ex. 4, page 151^ we can sup¬ 
pose that our scalar product is either hermitian or skew symmetric. 
The latter possibility can hold only if A = $ a field. 

EXERCISES 

1 . Let 4 be a non-degenerate hermitian or skew hermitian scalar product in 
9?. Prove that, if © is a finite dimensional non-isotropic subspace of 9?, then 
9? = © ㊉ @ ’ where ©' is the orthogonal complement of (@ is non-isotropic 
if© fl ©’ = 0, see page 151.) 

2 . (Rickart) A linear transformation U is h unitary if h{xU y yU) = h{x^y) 
holds for all x, ^ in A unitary transformation 1 such that / 2 = 1 is called an 
involution. Assume the characteristic of A is 5 ^ 2 and prove that, if I is an in¬ 
volution, then there exists a decomposition 況 = 況 + ㊉ where 9 ?+ and 9 ?— 
are non-isotropic and orthogonal and xl = x for x in and xl — —x for ^ 
in 9 ?-. 
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13. Schur’s lemma. A general density theorem. The range 
of applications of the results which we obtained for dense rings 
of linear transformations can be considerably broadened. We are 
going to show that these results apply to arbitrary irreducible 
rings of endomorphisms; for we shall prove that the two concepts 
— dense ring of linear transformations and irreducible ring of en¬ 
domorphisms — are fully equivalent. We have seen that every 
dense ring of linear transformations is an irreducible set of endo¬ 
morphisms. It remains to prove the converse. 

Thus suppose that 21 is an irreducible ring of endomorphisms 
of a commutative group 9?. Our first step is to introduce a divi¬ 
sion ring A relative to which 5R is a vector space and 21 is a set 
of linear transformations. This step can be taken because of the 
following fundamental lemma. 

Schur’s lemma. If 21 is an irreducible ring of endomorphisms 
in a commutative group then the ring S3 of endomorphisms that 
commute with every ^ e^L is a division ring. 

Proof. Let B be any non-zero element in S3. The image group 
dtB is invariant relative to 21. This is immediate from the commu¬ 
tativity of B with the elements of 31. Since diB ^ 0, the irreduci- 
bility of 21 implies that dlB = 9?. Next let 9^ be the kernel of the 
endomorphism B. Again we can verify that is an 21-subgroup. 
Also 沢 〆 9? since B 9 ^ 0. Hence 汧 = 0. This means that B is 
1-1. Thus we see that B is an automorphism of SR (onto itself). 
The inverse mapping B~ l is also an endomorphism. Clearly B— 1 
commutes with every A in 21. Hence B— 1 e S3. We have there¬ 
fore proved that every 5 ^ 0 of 93 has an inverse in 93. Thus S 
is a division ring. 

Since the ring of endomorphisms S3 is a division ring containing 
the identity endomorphism, the group dt together with 33 con¬ 
stitutes a right vector space. Here, of course，the scalar product 
xB y ^ in 5R, 5 in S is simply the image of x under B. In conformity 
with our consistent emphasis on left vector spaces we shall now 
regard 9J as a left vector space. We let △ denote a division ring 
anti-isomorphic to 33. Then if /3 5 is a definite anti-isomor¬ 

phism of A onto 58, the product I3x = xB turns 況 into a left vector 
space over A. Evidently the elements of SI are linear transforma- 
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tions in 9 ? over A (or 9 ? over 33). Also we know that the only 
endomorphisms that commute with every yf e 21 are the scalar 
multiplications. 

From now on we assume that 〆 0. Then if 9^ denotes the 
set of z such that zA = 0 for all yf， 沢 〆 But 況 is a subgroup 
invariant relative to 21 . Hence 9 ^ = 0 . This result means that， 
if x is any vector 〆0， then there exists an yf e 21 such that xA 
〆 0. Moreover, it is clear that the set x% of images xA of the 
fixed vector x is an 21-subgroup. Again by the irreducibility of 
21 we conclude that x% = 3 f. Thus if x 9 ^ 0 and y is any vector， 
then there exists an ^ in 21 such that xA = y. We have therefore 
proved that A is 1-fold transitive in the sense of the following 
definition. 

A set 21 of linear transformations in is k-fold transitive 
given any two ordered sets oi l < k vectors (xi y x 2y • • •， xi), 
(Ji，JV 23 • • yi) such that the %’s are linearly independent，there 
exists an e 21 such that X{A — yi for i = 1 ，2， • • • /• 

We continue our analysis of irreducible sets of endomorphisms 
by proving next that SI is two-fold transitive. Here we shall make 
use of the fact that the scalar multiplications are the only endo¬ 
morphisms which commute with all the A in 3(. As a preliminary 
to the proof we note that a ring of linear transformations is 々-fold 
transitive if 1 ) 21 is 1 -fold transitive, and 2) if (心， x 2y • • •， x{) are 
1 < k linearly independent vectors, then for any i = 1 ，2， ..•，/， 
there exists a linear transformation Ei in 21 such that 

XjEi = 0 for j 9 ^ i and XiEi ^ 0 . 

For if i = 1，2， •••，/，exists, then we can find a Bi in 21 such 
that XiEiBi = yi ， Then A = IhEiBi has the required properties 
XiA = i = 1, 2 y Now take / = 2 and suppose on the 

contrary that there is no £ in 21 such that XiE = 0 but x 2 E 9 ^ 0. 
Then if B is any element of 21 such that X\B = 0 also x 2 B = 0. 
This fact implies that the correspondence X\A x 2 A, A vary¬ 
ing in 21 is single-valued. For if x x A = X\A\ A and A r in SI, then 
X\B = 0 for B = A — A r . Hence 0 = x 2 B = and 

x 2 A = X 2 A’. Now we know that the set of images x^i is the 



INFINITE DIMENSIONAL VECTOR SPACES 


273 


whole space Also it is clear that our mapping is a homomor¬ 
phism. Hence it is an endomorphism of 9 ?. If C is any linear 
transformation in 21 ， then 

{x\A)C = X\AC —> X 2 AC = [x 2 ^) C 

and this shows that the mapping X\A — x 2 A commutes with C. 
It follows that this mapping is a scalar multiplication, that is, 
there exists a. /3 e A such that x 2 A = holds for all A. Thus 

(x 2 — I3xi)y4 = 0 for all A. Hence x 2 = PiXi and this contra¬ 
dicts the linear independence of x 1 and x 2 - 

Our final step is to show that 21 is dense in 2 or, what is the same 
thing, 21 is 是 -fold transitive for all k. We shall，in fact, prove 
somewhat more, namely, we shall show that any two-fold transi¬ 
tive ring of linear transformations is dense. Suppose 21 has this 
property and assume that we know already that 21 is 是 -fold transi¬ 
tive for a particular k. Then the result will follow by induction 
if we can show that, if x iy x 2y …， ^+i are linearly independent 
vectors, then there exists a transformation F in 21 such that 
XiF = 0 for i < k but x k+ \F 7 ^ 0. By the induction assumption 
we know that there exist Ej in 21 such that 

X iEj = dijXiy iy j = 1 ， 2 ， ••• ，々 • 
k 

We set E = ^2 Ei and we consider first the case in which 

1 

9 ^ Xk + i. Then Xk+iE — ^+i ^ 0 and there exists an / in 21 
such that (xjc+iE — 9 ^ 0. Then F = EA — A 

x k+1 F = x k+ i(EJ — J) = (x k+ iE — x k+x )A 7 ^ 0. 

On the other hand ，XiE = Xi for i < k\ hence XiEA = XiA and 
XiF = 0. Suppose next that Xk+iE = Xk+i- Then we assert 
that there is ryi i < k such that Xi are linearly independ¬ 

ent; for ， otherwise, Xk+iEi = PiXi and 

Xk+i = x k ^iE = Xx k+ iEi = X/3iXi 

contrary to the linear independence of x iy x 2y … ， ^+i* Now 
let x k+1 Ei and Xi be linearly independent for a particular /. Then 
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since SI is two-fold transitive, there exists a jB e 21 such that 
Xk+iEiB 7 ^ 0 but XiB = 0. If we set F = E{B y we find that 
XjF = XjE{B = 0 for j i and < k and XiF = 0 but Xk+\F ^ 0. 
This proves our assertion and completes the proof of the following 

General density theorem. Let 21 be any irreducible ring of endo- 
morphisms ^ 0 in a commutative group and regard dt as a left 
vector space over a division ring A anti-isomorphic to the division 
ring of endomorphisms which commute with every A in 21. Then 21 
is a dense ring of linear transformations in 9J over A. 

14. Irreducible algebras of linear transformations. The theo¬ 
rems of the preceding section can also be applied to irreducible 
algebras of linear transformations, and in this form they give 
some results which are fundamental in the theory of group repre¬ 
sentations. We proceed to derive these results. Thus we begin 
with a vector space 9? over a field 中 and with an algebra §1 of 
linear transformations in 9? over The assumption that H is 
an algebra means that 21 is closed under the compositions of ad¬ 
dition and multiplication and under multiplication by elements of 
$ (or 

Assume now that 21 is irreducible as a set of linear transforma¬ 
tions (cf. § 1， Chapter IV). Thus we are assuming that the only 
subspaces of 9? which are invariant relative to SI are 9? and 0 or， 
equivalently, that the set (21, $0 is an irreducible set of endo¬ 
morphisms. We shall now show that，if 21 〆0， then SI itself is 
irreducible as a set of endomorphisms. To prove this let x be 
any vector 9 ^ 0 in dt. Consider the set x% of vectors xA. Since 
H is an algebra，^21 is a subspace. Also it is clear that is 21- 
invariant. Hence，either ^21 = SR or ^21 = 0. If the second alter¬ 
native holds，then the set 沢 of vectors z such that 2:21 = 0 con¬ 
tains non-zero vectors. Clearly 5R is a subspace and 9^ is 21 in¬ 
variant also. Hence 9^ = 9? and 21 = 0 contrary to assumption. 
We therefore have ^21 = SR for any non-zero x and this implies 
directly that % is an irreducible set of endomorphisms. 

We can now apply the results of the preceding section. For 
this purpose we consider the ring S3 of endomorphisms which 
commute with every A z%. Evidently S3 2 We observe next 
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that the elements of S3 are linear transformations. Thus let ai e 
jB eS3. Then for any yf e 21 we have 

0 = B{aiA) — {aiA)B = {Bai)A — ai{AB) 

= {Ba\)A — a\{BA) = {Ba\)A — {aiE)A 
=(Bai — a\E)A. 

Now，if Bai — aiB ^ 0, then we can find a vector x such that 
y — x{Boli — aiB) 0. Then yA = 0 for all and this con¬ 
tradicts the irreducibility of 21. Thus Bon = aiB for every ai y 
and 5 is a linear transformation. We have therefore proved that 
S3 is also the totality of linear transformations which commute 
with the elements of 31. Clearly 58 is an algebra of linear trans¬ 
formations. By Schur’s lemma S3 is a division algebra. 

We now follow the procedure of the preceding section and in¬ 
troduce the division algebra A anti-isomorphic to 93. Since S3 
contains 中 z we can suppose that A 3 Also it is easy to see 
that we can regard 況 as a left vector space over A in such a way 
that the scalar multiplication by the elements of the subset <i> is 
the original scalar multiplication. The main density theorem 
now states that 21 is a dense set of linear transformations of 9i 
over A. 

We shall now specialize our results to obtain some classical 
theorems on algebras of linear transformations. We assume that 
中 is algebraically closed and that 況 is finite dimensional over 
Let 21 be an irreducible algebra of linear transformations in 9? 
over 中 . Let jB be a linear transformation which commutes with 
every element of 21. Then B is an endomorphism that commutes 
with every element of the irreducible set (H, ^z). Hence by 
Schur’s lemma either 5 is 0 or 5 is non-singular. Now let p be 
a root of the characteristic polynomial of B. Then C = B — pi 
commutes with every A z%. But det C = 0 so that C is singular. 
Hence C = 0 and B = pi ， We have therefore proved that the 
only linear transformations which commute with every A are 
the scalar multiplications. The same result can also be estab¬ 
lished for irreducible sets of linear transformations. Thus if 0 
is such a set, then the enveloping algebra 21 (cf. § 6 of Chapter IV) 
of 12 is an irreducible algebra of linear transformations. More- 
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over，if 5 is a linear transformation which commutes with every 
A then B commutes with every A z%. Hence we can state 
the following theorem which is one of the most useful special 
cases of Schur’s lemma. 

Theorem 10. Let 12 be an irreducible set of linear transformations 
in a finite dimensional vector space 9? over an algebraically closed 
field. Then the only linear transformations which commute with 
every A are the scalar multiplications. 

An immediate consequence of this result and of the density 
theorem is 

Burnside’s theorem. If % is an irreducible algebra 7 ^ 0 of linear 
transformations in a finite dimensional vector space over an alge¬ 
braically closed field、then 21 = S the complete algebra of linear 
transformations. 

Proof. By Theorem 10 the division algebra of linear transfor¬ 
mations commuting with the ^ e SI is 中 Hence by the density 
theorem, SI is a dense set of linear transformations of dt over 
Since 9? has a finite basis over 中， this implies that 21 = S. 



INDEX 


Algebra, 26, 225 
free, 210-211 
Grassmann, 211 
of linear transformations, 36 

Bases, 15 
Cartesian, 173 
change of, 42 
complementary, 53 
matrix of, 15 

of infinite dimensional vector 
spaces, 239 
unitary, 190 
Bilinear forms, 137 
matrices of, 138 
non-degenerate, 140 
Burnside’s Theorem, 276 

Canonical matrices: 
classical, 73, 94 
Jordan, 70, 93 
Chain conditions, 28 
Characteristic polynomial, 98， 103 
Characteristic roots, 104 
of real symmetric matrices, 180 
Characteristic spaces, 182 
Characteristic vector, 100, 186 
Cogredience (of matrices), 149 
Commutative sets of linear trans¬ 
formations, 133-135 
Complete reducibility: 

of a single linear transformation, 

129 

of sets of linear transformations, 
124 

orthogonal, 177 


Composition series, 120 
Conjugate space, 52 

of infinite dimensional vector 
space, 244 

Cyclic linear transformations，69 
elementary divisors, 73 

Decomposability : 

of a single linear transformation, 
129 

of sets of linear transformations, 

122 

Dense rings of linear transforma¬ 
tions, 259-264 
Dimensionality: 
of free modules, 89 
of infinite dimensional vector 
spaces ， 241, 244 
of vector spaces, 10, 14 
Direct product: 

of linear transformations, 203 
of spaces, 201 
Direct sum: 
of submodules, 85 
of subspaces, 30 
Duality: 

of infinite dimensional vector 
spaces, 253 

of vector spaces and conjugate 
spaces, 54 

Elementary divisors, 73, 94 
Endomorphisms : 

of cyclic module, 106 
of finitely generated module for 
principal ideal domain, 108 


277 



278 


INDEX 


Exponential function, 197 
Extension of field of vector space ， 
221 

Factor space, 25 

Finitely generated commutative 
groups, 88 

Frobenius Theorem, 102, 111 

Gaussian domain, 101 
General density theorem，274 
Geometry: 

Euclidean, 172 
unitary, 190 
Group : 

full linear, 46 
unitary, 191 

Hamilton-Cayley Theorem, 101 
Ideals : 

elementary divisor ideals，94 
in ring of linear transformations, 
230, 232, 256 
invariant factor ideals, 92 
order ideal，85 
Invariant factors, 84 
Irreducible: 

algebras of linear transforma¬ 
tions, 274 

set of endomorphisms, 259 
set of linear transformations, 116 
Isomorphisms: 

in infinite dimensional vector 
spaces, 264 

of rings of linear transforma¬ 
tions, 233 

Jordan-Holder Theorem, 127 

Kronecker delta，17 
Kronecker product : 
of algebras, 225 

of infinite dimensional vector 
spaces, 256 

of linear transformations, 211 


Kronecker product (Cont.) 
of matrices, 213 
of vector spaces, 208 
Krull-Schmidt Theorem, 127 

Lattices, 26 

complemented, 27, 125 
modular, 27 
Linear dependence, 10 
Linear equations, 47 
Linear function, 32, 51 
Linear transformations : 
addition of, 32 
analytic functions of ，194 
commuting with a given one, 
110 

definition, 32 

induced in invariant subspace 
and factor space, 117 
in right vector spaces, 49 
matrix of ， 36-37 
minimum polynomial of, 65 
normal, 184 
nullity of, 44 
orthogonal，178 
polar factorization, 188, 192 
power series in a linear transfor¬ 
mation, 195 
product of, 34 
rank of, 44 
semi-definite, 186 
skew, 178 
symmetric, 178 
transpose of, 56, 142 
unitary, 191 

Matrices, 15, 18 
addition of, 39 
column rank of, 22 
elementary divisors of, 94 
elementary matrices, 19, 82 
equivalence of ， 42, 79 
hermitian ， 150, 191-192 
in infinite dimensional vector 
spaces, 243 



INDEX 


279 


Matrices {Cont.) 
invariant factors of, 84 
multiplication of, 39 
non-singular, 16 
normal, 185 
normal form of, 84 
of bases, 15 

of bilinear forms, 138, 149 
of linear transformations, 37 
of transpose, 58 
orthogonal，175 
row rank of, 22 
similarity of, 43 
symmetric, 179 
Minimum polynomial, 65, 98 
degree of, 69 
Modules, 7 
cyclic, 85 
equivalence of, 8 
factor, 88 

finitely generated, 8, 76, 85 
free, 8, 76 
generators of, 8 
submodule, 7 

Partially ordered set, 26 
Primary components, 130-132 
Product group of vector spaces, 
200 

Projection, 60 
orthogonal, 60 
supplementary, 60 

Rank: 

column rank of matrices, 22 
determinantal rank, 23 
in infinite vector spaces, 256 
of a set of vectors, 22 
of linear transformations, 44 
row rank of matrices, 22 
Reducibility: 

of a single linear transformation, 
128 

of sets of linear transformations, 
116 


Ring of linear transformations : 
anti-automorphism, 267 
automorphism, 237 
center of, 114 
finite topology in, 248 
isomorphisms, 233, 266 
left ideals in, 230 
right ideals in, 232 
simplicity, 227 
two-sided ideals in, 256 
Rotation, 179 

Scalar products, 148 
alternate, 160 
hermitian, 150 
non-degenerate, 151 
totally regular, 167 
weakly hermitian, 268 
Schmidt’s orthogonalization proc¬ 
ess, 174 

Schur’s lemma, 271 
Subspaces: 
cyclic, 66 
direct sum, 30 
independent, 28 
invariant, 66, 115 
isotropic, 151 

of infinite dimensional vector 
spaces, 242 
total, 251 

Sylvester’s Theorem, 156 

Tensors, 213 

contraction of，215 
skew symmetric, 218 
symmetry classes, 217 
Topological space, 248 
Trace of a matrix， 99，103, 216- 
217 

Transitivity, 272 
Vectors: 

linear dependence, 10 
order of, 67 



280 


INDEX 


Vectors {Cont.) 
product, 1 
scalar product, 1 
sum, 1 

Vector spaces: 

abstract (finite dimensional), 3 
conjugate space of, 53 
cyclic, 69 


Vector spaces {Cont.) 
dimensionality of, 10, 14 
infinite dimensional, 238 
Kronecker product of, 208 
right，6 
two-sided, 204 

Witt’s Theorem, 162 





